Posted 20 days ago

Senior Databricks Engineer


Not disclosed
Full time
Time commitment
Not disclosed
Company size


Data Engineering

Job description

A U.S.-based company that is developing a financial service platform that provides real estate investors and borrowers with rental and bridge loans, is looking for a Senior Databricks Engineer. The engineer will be responsible for guiding team members through best practices and cutting-edge data engineering technology. The company equips real estate agents with cutting-edge technologies and immediate funding to fund opportunities. The company has managed to secure more than $155mn in funding so far. 
Job Responsibilities:
  • Break down complex projects into actionable steps
  • Oversee the development and implementation of Databricks and Snowflake-based data migration solutions in an AWS environment
  • Develop and maintain real-time data pipelines, data lakes, and data warehouses in collaboration with cross-functional teams to understand data requirements and translate them into technological solutions 
  • Assure that compliance, security, and data quality criteria are met
  • Design and implement data pipelines that turn raw data into actionable insights
Job Requirements:
  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 5+ years of relevant experience as a data engineer
  • 5+ years of experience with Databricks, Python, and AWS
  • Extensive experience in Stream Processing, DLT (data live tables)
  • Nice to have extensive experience working with PySpark and Snowflake
  • Strong understanding of data modeling, delta lake, data warehousing, and ETL concepts 
  • Demonstrable experience with Stream Processing specifically with Spark Structured Streaming, DLT, etc 
  • Prior experience working with data governance and security best practices 
  • Must have some certifications such as Databricks Lakehouse Data Engineer, Associate, and AWS Certified Developer Associate
  • Some experience with data migration in a regulated industry such as healthcare or finance is nice to have
  • Familiarity with containerization and orchestration technologies such as Kubernetes and Docker is desirable
  • Nice to have some experience with data visualization tools such as Tableau or Looker 
  • Experience with agile development methodologies is preferred
  • Strong communication and leadership skills to effectively collaborate with cross-functional teams
  • Fluent in spoken and written English
Interested in this job?
Apply Now
Other jobs like this
1 day ago
Not disclosed
Full time
4 days ago
Not disclosed
Full time
5 days ago
Not disclosed
Full time
Share this job

Fast track Your Remote Work Career


Sign up

Create your profile by sharing your personal and professional details with us.


Take our online talent assessment for skills and competencies evaluation.


Get matched to in-demand jobs and accelerate your freelance career.

Interested in more opportunities like these?

Join now