Data Platform Engineer

New Today

JoinusasaDataPlatformEngineerforourclient. AtPeregrine,werealwaysseekingSpecialistTalentthathavetheidealmixofskills,experience,and attitude,toplacewithourvastarrayofclients.FromBusinessAnalystsinlargegovernment organisationstoSoftwareDevelopersintheprivatesectorwearealwaysinsearchofthebest talenttoplace,now. HowSpecialistTalentWorks AtPeregrine,wefindthebesttalentforourclients.AsapermanentemployeeofPeregrine,with accesstoallourstandardbenefits,youwillbedeployedacrossourportfolioofclientsasaspecialistconsultant,workingonawidearrayofcomplexprojectsacrossmultipleindustries. TheRole: AsaDataPlatformEngineerinahighlyregulatedenvironment,youwillberesponsiblefordesigning,building,andmaintainingsecureandscalabledatainfrastructurethatsupportsbothcloudandonpremisesplatforms.Youwillplayakeyroleinensuringthatalldatasystemscomplywithindustryregulationsandsecuritystandardswhileenablingefficientaccessforanalyticsandoperationalteams. AstrongcommandofApacheNiFiisessentialforthisrole.Youwillbeexpectedtodesign, implement,andmaintaindataflowsusingNiFi,ensuringaccurate,efficient,andsecuredata ingestion,transformation,anddelivery.Youshouldbeadeptatidentifyingandresolvingissues withinNiFiflows,managingperformancebottlenecks,andimplementingrobusterrorhandling strategies. Youllworkcloselywithcross-functionalteamsincludingdataarchitects,complianceofficers,and cybersecurityspecialiststointegratedatafromvarioussystemssuchasdatabases,APIs,andcloud platforms.Yourworkwilldirectlysupportbatchprocessing,real-timestreaming,andevent-driven datapipelinesacrossavarietyofusecases. Werelookingforcandidateswithover3yearsofrelevantexperienceindataengineering,platform engineering,orarelatedfield,withdemonstratedhands-onexpertiseinNiFianddatapipeline designinregulatedenvironments. Responsibilities: Design,develop,andmaintainrobustandsecuredatapipelinesusingNiFiandrelated bigdatatechnologies. TroubleshootandoptimizeNiFiflows,includingperformancetuning,errorresolution, andflowcontrol. IntegrateNiFiwithcloudplatforms,databases(SQL&NoSQL),APIs,andthird-party systems. Ensurecompliancewithregulatoryandsecurityrequirementsacrossdatastorage, transfer,andaccesslayers. Supportdatamigrationeffortsandimplementdisasterrecoveryprotocols. Continuouslymonitordatainfrastructureperformanceandrecommendimprovements. Collaboratewithcross-functionalteamstoaligndataplatformcapabilitieswithbusiness needsandcompliancerequirements. Maintaindocumentationofdataflowsandprocesses,ensuringknowledgesharingand operationaltransparency. Skills&Experience: Youwillhavethefollowingskillsorprovenexperience: ApacheNiFiExpertise: DeepunderstandingofcoreNiFiconcepts:FlowFiles,Processors,ControllerServices, Schedulers,WebUI. Experiencedesigningandoptimizingdataflowsforbatch,real-timestreaming,and event-drivenarchitectures. Abilitytoidentifyandresolveflowissues,optimizeperformance,andimplementerror handlingstrategies. OptionalscriptingskillsforcreatingcustomNiFiprocessors. Programming&DataTechnologies: ProficiencyinJavaandSQL. ExperiencewithC#andScalaisaplus. ExperiencewithETLtoolsandbigdataplatforms. Knowledgeofdatamodeling,replication,andqueryoptimization. Hands-onexperiencewithSQLandNoSQLdatabasesisdesirable. Familiaritywithdatawarehousingsolutions(e.g.,Snowflake,Redshift,BigQuery)would bebeneficial. DataPlatformManagement: Comfortableoperatinginhybridenvironments(cloudandon-prem). Experienceintegratingdiversedatasourcesandsystems. Understandingofsecuredatatransferprotocolsanddisasterrecoveryplanning. CI/CD&DevOpsPractices: ExperienceworkingwithCI/CDpipelinestoautomatedeploymentofNiFiflowsanddata infrastructurecomponents. FamiliaritywithtoolssuchasGit,Jenkins,AzureDevOps,orsimilar. WaysofWorking: ComfortableworkinginAgile/Scrumenvironments,participatinginsprintplanning, stand-ups,andretrospectives. ExperienceusingAgilecollaborationtools(e.g.,Jira,AzureDevOps,Confluence). Communication: Abilitytoclearlyexplaintechnicalconceptstobothtechnicalandnon-technical stakeholders. Strongwrittenandverbalcommunicationskills. Experiencecreatingandmaintainingtechnicaldocumentation. Collaboration&RelationshipManagement: Proventrackrecordofcross-functionalcollaborationwithproduct,engineering,security, compliance,andbusinessteams. Stronginterpersonalskills;abletobuildtrustandmanagestakeholderexpectations. Abletoadapttodiverseworkingstylesandteamdynamics. AnalyticalThinking&Problem-Solving : Stronganalyticalskillsfortroubleshootingcomplexdataflowandinfrastructureissues. Abilitytojugglemultipleprioritiesandadapttodynamicworkloads. Detail-orientedwithacommitmenttohigh-qualitydelivery. Aboutus: AtPeregrine,weseebeyondtheimmediateandlooktothehorizon.Webuildlasting,meaningful partnershipswithourclients,anddeliverflexiblesolutionsforeveryresourcingneed,bothnowandinthefuture.Together,wehelpourclientstoengage,developandharnesstheskillstheyneedtoachieveandgrowtheworkforcetheywant.Wehavearangeofbenefitsyouwillreceivealongsideyoursalary. Ourculture: AtPeregrineweembracefreshideas,andwelovelearningfast.Oursolutionsaretrustedand established,sowehavetheconfidenceofknowingwehaveasolidfoundation.Werelyonopennessandhonesty,andwerealwaysreadytohelpeachotherout.Andwebelievethatourworkcanbenefitsocietywhetheritsfindingthedigitaltalentofthefutureorbeingadriverforsocialmobility. Ourcommitmenttodiversity: AtPeregrine,wereproudlycommittedtochampioningdiversityandinclusion,withcompany-wide initiativestodrivegreatersocialmobilityandreduceourenvironmentalimpact.Ourteams representahugebreadthofcultures,languages,andethnicities,andover20differentnationalities. Wealsoemploycandidatesfromarangeofeducationalandsocioeconomicbackgrounds.Our partnershipswithnumerouscharitiesensurethatwecanstaywell-informedandcontinueto improveourpracticesforthefuture.Itreflectsinthewaywerecruitforourclientsasweassisttheminbecomingmorediverse

TPBN1_UKTJ
Location:
United Kingdom
Job Type:
FullTime
Category:
IT