Senior Databricks Engineer Job at Jconnect Infotech Inc, Weehawken, NJ

a0JFMlFDUUthOXJhYklCOUYrdUpGcElFZVE9PQ==
  • Jconnect Infotech Inc
  • Weehawken, NJ

Job Description

Must have

Bachelor's and/or Master's degree in Computer Science, Computer Engineering or related technical discipline

Senior Data Engineer with at least 15+ years of industry experience (10+ minimum experience working in Financing Domain)

At least 10+ years of experience in working in large global teams, especially for high-performance, large-scale systems data warehouse solution using Data bricks , Spark (Python/Scala) (good hands-on development experience on Databricks and spark)

Microsoft Azure experience is a must

Spark/Databricks batch and streaming solutions (Delta Lake, Lakehouse)

Knowledge of Azure Data Factory and Cosmos DB

Knowledge of Kafka, Event hubs and ADLS Gen2 on Microsoft Azure

Understanding of dev ops tools and engineering practices using micro-services, ci/cd pipeline and test automation

Cloud technologies & design patterns

building and optimizing 'big data' data pipelines, architectures, and data sets

proven skills in performance tuning and quality improvements

Strong in Algorithms and Data Structures

Infrastructure-as-code, using tools such as Terraform, ARM, Bicep or CloudFormation

Azure CLI, setting up ADO pipelines, Terraform Enterprise, etc

Job Tags

Similar Jobs

5 Star Recruitment

Quantitative Developer Job at 5 Star Recruitment

 ...~ Masters degree in quantitative disciplines ~ Proficient in SQL, any other high level programming languages, such as R, Python, Matlab, is a plus ~ Hands on experience on developing complex financial models. ~ Solid equity production knowledge, especially ETFs... 

SLADE GLASS CO

Junior Graphic Designer Job at SLADE GLASS CO

 ...We are currently looking for a talented Junior Graphic Designer to join our remote team. As a junior graphic designer, you will be responsible for creating visual concepts, developing branding materials, and implementing design solutions for a variety of projects. This... 

Hire it People, Inc

C# .NET Developer Job at Hire it People, Inc

Job Seekers, Please send resumes to ****@*****.*** Required Skills: Overall IT experience: Required. 4-8 + yrs. C#.Net experience. Required. 4-6 yrs. MVC: Required. 4-6 yrs. SQL and MySQL: Required. 4-6 yrs. Javascript, HTML, CSS, jQuery: Required...

Raider T Recruiting

Remote Talent Acquisition Specialist | Remote Work Job at Raider T Recruiting

Position Details - 1099 position, set your own schedule. - Work from home recruiter position - Paid per driver hired. Uncapped Commissions. - Work with managers at client level to understand current staffing needs and provide updates on applicant status. - Assist...

Oak Ridge National Laboratory

Research associate - molecular Job at Oak Ridge National Laboratory

 ...Requisition Id14070Overview: We are seeking a Postoctoral Researcher to work with Professor Jeremy C Smith along with a team of...  ...laboratory provides a range of employee benefits, including medical and retirement plans and flexible work hours, to support the well...