logo

View all jobs

Data Engineer

Open, Remote · Computer/Software
Our client is a growing team and is looking for talented individuals to help us define and drive the success of our cloud based service offerings.

The Opportunity:

As a Senior Data Engineer, you will focus on providing actionable insights and build highly available resilient systems that will impact and help make business decisions. You will ensure that the platform service we are delivering will meet both our and our customers' reliability expectations.

What you will do:
  • Build infrastructure and abstractions that can enable anyone (engineer or data scientist) to craft a scalable ETL pipeline for whatever the purpose is: metrics, analysis, machine learning, dashboard visualizations
  • Work closely with team to monitor and tune existing infrastructure.
  • Make intuitive decisions about what services, frameworks, and capabilities need to be in place before they are needed.
  • Build and maintain a data collection system that robustly extracts meaningful data from multiple sources and data stores.
  • Build analytics and Machine learning platforms to collect, store, process, and analyze huge sets of data
Who you are:
  • BA/BS in Computer Science, Information Systems or related technical field.
  • 3+ years of experience in Data Infrastructure, with Cloud SW experience a plus.
  • Experience in crafting and scaling data infrastructure, models, and pipelines
  • Hands-on experience with a variety of data infrastructures, such as:
  • elasticsearch, postGIS, 
  • Processing: Spark, Flink, Hadoop, Lambda
  • Messaging: Kafka, Zookeeper, Pulsar
  • Storage: Hive, Mongo DB, Athena, Phoenix, Splice, Redshift, DynamoDB, Cassandra
  • Machine Learning: Sagemaker, H2O, Keras, NumPy
  • Open and active in sharing knowledge as well as excellent communication skills
  • Programming experience in one or more application or systems languages including Scala, Java, or Python
  • Have an ability to own a project from inception to completion
VANTA Partners
www.vantapartners.io
Vanta Partners Glassdoor Page

 

Share This Job

Powered by