Job Description:
Sr. Scala Data Engineer
Department/Product Overview:
Dow Jones is seeking a Sr. Data Engineer to join our team in Barcelona working on the DNA platform, a Google Cloud and Strata Data award winning Data as a Service platform. The DNA platform provides our clients batch extractions of up to 1.5 billion news articles and real time news streams from over 30,000 sources. https://www.dowjones.com/dna
Primary Responsibilities/Accountabilities:
Design, develop and deploy backend services in Scala
Design, develop and deploy data pipelines in Google Cloud Dataflow and Apache Spark in Scala
Write unit and integration tests
Write analytical SQL queries on Big Query
Provides advice, guidance and training to other teammates
Knowledge/Experience:
Bachelor's degree or equivalent work experience in Computer Science or related field of study
Functional programming
Writing modern batch and streaming data pipelines (Apache Spark, Beam, ect.)
Experience with CI/CD technologies such as Jenkins, Google Cloud Build or TeamCity
Preferred Tools/Skills:
Google Cloud Big Data tools (Dataflow, Dataproc, BigQuery)
FP Scala libraries (cats, scalaz, http4s and doobie)
Exposure to Docker, Kubernetes or other cloud or container based application deployment
What we’re offering:
Private Health Insurance
Flexible working times
Virgin app to get extra money doing exercise (yes, more you walk, more you get)
Possibility to work from home sometimes
Internal Hackathons
Lunch and learn events
#bcntech
Dow Jones , Making Careers Newsworthy
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets .
Dow Jones is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, please reach out to us at TalentResourceTeam@dowjones.com. Please put “Reasonable Accommodation" in the subject line.
Business Area: TECHNOLOGY - PRODUCT DEVELOPMENT
Job Category: IT Development Group
Req ID: 25651
