Hadoop/ Big data Developer Job at Cloud Analytics Technologies LLC, Richmond, VA

ZzBCZkN2ZU1Db3VRMjNDR1k3ck1GNEZLT0E9PQ==
  • Cloud Analytics Technologies LLC
  • Richmond, VA

Job Description

Job Description

Job Description :

Working Experience Software/Tools;

Experience with big data tools: Hadoop, Apache Spark, Kafka, etc.

Experience with Docker and Kubernetes

Experience with relational SQL, Snowflake and NoSQL databases, including Postgres and Cassandra.

Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift Experience with stream-processing systems: Storm, Spark-Streaming, etc.

Experience with object-oriented/object function scripting languages: Python, Java, C++, PySpark, Scala, etc.

Responsibilities for Data Engineer:

  • Create and maintain optimal data pipeline architecture,
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.

Job Tags

Work experience placement,

Similar Jobs

Jefferson Health

Radiology Technologist (Per Diem) - Stratford Campus Job at Jefferson Health

Job Details The Radiology Technologist performs x-ray scans of patient's internal anatomy to aid physicians in diagnosing illnesses, diseases, or injuries. Executes radiologic services in compliance with relevant laws and regulations and provides consultation advice...

Hill Management Group

Sales and Customer Service Associate Job at Hill Management Group

 ...SALES AND CUSTOMER SERVICE ASSOCIATE NEEDED: JOIN A TEAM THAT INVESTS IN PEOPLE! Looking...  ...local customers about Verizons telecom offerings while becoming part of a team...  ...conversations that lead to action. Hill Management Group is here to build careers, serve communities... 

Alldus International Consulting Ltd

ServiceNow Developer (TS/SCI Full Scope Poly) Job at Alldus International Consulting Ltd

Our client, an IT Services and Consulting company, are hiring a ServiceNow Developer to join the team in Maryland. The successful candidate will design and enhance enterprise applications, manage full software lifecycle, implement updates and testing, analyze project progress... 

South Texas Health System

Physical Therapy Assistant FT Job at South Texas Health System

 ...Responsibilities POSITION SUMMARY: Staff Physical Therapy Assistant (PTA) is responsible for providing physical therapy services under the...  ...ability to move or perform functional activities. Some travel may be required in the provision of services between facilities... 

Charlie's Produce

Order Selector Job at Charlie's Produce

Who We Are Charlie's Produce is the largest privately-owned produce wholesaler on the West Coast, and we are growing. The secret to our success in this industry is PEOPLE! We strive to hire the best and we reward them with a working environment that fosters loyalty...