Data Engineering Tech Lead - Hadoop Job at Cloud Analytics Technologies LLC, Cleveland, OH

UjhUbG5PZTV4RkJPUTZhM2pYL1RiZEpJdHc9PQ==
  • Cloud Analytics Technologies LLC
  • Cleveland, OH

Job Description

Key Roles & Responsibilities

  • Lead and oversee the end-to-end design, implementation, and optimization of  data pipelines supporting key customer onboarding, transaction, and decisioning workflows.
  • Architect and implement  data ingestion, transformation, and storage frameworks leveraging  Hadoop Avro , and distributed data processing technologies.
  • Partner with product, analytics, and technology teams to translate business requirements into scalable data engineering solutions that enhance real-time data accessibility and reliability.
  • Provide  technical leadership and mentorship to a team of data engineers, ensuring adherence to coding, performance, and data quality standards.
  • Design and implement robust data frameworks to support next-generation customer and business product launches.
  • Develop best practices for  data governance security , and  compliance aligned with enterprise and regulatory requirements.
  • Drive optimization of existing data pipelines and workflows for improved efficiency, scalability, and maintainability.
  • Collaborate closely with analytics and risk modeling teams to ensure data readiness for predictive insights and strategic decision-making.
  • Evaluate and integrate emerging data technologies to future-proof the data platform and enhance performance.

Must-Have Skills

  • 8–10 years of experience in  data engineering , with at least 2–3 years in a technical leadership role .
  • Strong expertise in the  Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
  • Experience working with  Avro Parquet , or other serialization formats.
  • Proven ability to design and maintain  ETL / ELT pipelines using tools such as  Spark Flink Airflow , or  NiFi .
  • Proficiency in  Python Scala for large-scale data processing.
  • Strong understanding of  data modeling data warehousing , and  data lake architectures.
  • Hands-on experience with  SQL and both  relational and  NoSQL data stores.
  • Cloud data platform experience with  AWS .
  • Deep understanding of  data security compliance , and  governance frameworks .
  • Excellent problem-solving, communication, and leadership skills.

Job Tags

Similar Jobs

AFSCME District Council 36

Union Representative Job at AFSCME District Council 36

 ...AFSCME District Council 36 Union Representative Los Angeles, CA (for servicing various AFSCME 36 Public and Private Sector affiliates as assigned) Background The American Federation of State, County and Municipal Employees (AFSCME) is the countrys largest... 

Lakeside Golf Club

Assistant Pastry Chef Job at Lakeside Golf Club

Position Summary The Pastry Cook is responsible for daily production of pastries, desserts, and components for member dining, banquets...  ...by executing new recipes and components provided by the Pastry Chef. Work efficiently and independently without requiring oversight... 

Cloud Analytics Technologies LLC

.Net C# developer Job at Cloud Analytics Technologies LLC

 ...mechanical troubleshooting Experience programming software applications in C#.NET and/or PLC devices is desired Proficient with the Microsoft Windows operating system. Strong oral and written communication skills Experience operating industrial machinery and/or... 

MV Transportation, Inc.

Auto Mechanic Job at MV Transportation, Inc.

 ...Hiring Now: Full-Time Mechanic 37/hr, $3000 SIGN ON BONUS MV Transportation is looking for a skilled, experienced Mechanic to join our team in Cary, NC. If youre looking for steady hours, dependable pay, and long-term stability with room to growthis could be... 

Merry Edwards Winery Merry Edwards Winery

2026 Harvest Cellar Intern at Merry Edwards Winery Job at Merry Edwards Winery Merry Edwards Winery

 ...Job Description: Title: Seasonal Harvest Cellar Intern Reports to: Cellar Master Merry Edwards Winery was founded in 1997 and produces terroir-driven, single-vineyard Pinot Noirs, including the winery flagship Meredith Estate, from 80 acres of certified sustainable...