Thank you for applying to VTRAC opportunities. Please e-mail your resume as a MS-WORD document in confidence Subject: Data Engineer (AWS), Attention:[email protected] or call: 647-722-4640
Position#: 23008 Position: Data Engineer (AWS) Position Type: Permanent No. of Positions: 1 Location Florida (REMOTE)
Description
As a Data Engineer, you will be working within a team to design and implement highly available data services and pipelines. This is an ideal job if you have proven experience as a technical professional and have already collaborated with teams to deliver production systems based on big data solutions.
Responsibilities
Analyze and organize raw data
Build data systems and pipelines
Evaluate business needs and objectives
Interpret trends and patterns
Conduct complex data analysis and report on results
Prepare data for prescriptive and predictive modeling
Build algorithms and prototypes
Combine raw information from different sources
Explore ways to enhance data quality and reliability
Identify opportunities for data acquisition
Develop analytical tools and programs
Collaborate with data scientists and architects on several projects
Qualifications
2+ years of work experience with ETL, Data Modeling, and Data Architecture.
Expert-level skills in writing and optimizing SQL.
Experience with Big Data technologies such as Hadoop/Hive/Spark.
Solid Linux skills.
Experience operating very large data warehouses or data lakes
Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
Experience with building data pipelines and applications to stream and process datasets at low latencies.
Show efficiency in handling data – tracking data lineage, ensuring data quality, and improving discoverability of data.
Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines and knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
Skills
AWS Cloud, AWS Redshift, AWS Athena
AWS Glue, AWS QuickSight
Agile SDLC, JIRA, Confluence
SQL, NOSQL
AWS S3
We thank all candidates in advance. Only selected candidates for interviews will be contacted. For other exciting opportunities, please visit us at www.vtrac.com. VTRAC is an equal opportunity employer.