undefined
Posted 20 days ago

Senior Databricks Engineer

Details

undefined
Not disclosed
Compensation
undefined
Full time
Time commitment
undefined
Not disclosed
Company size

Skills

Data Engineering
Python
AWS

Job description

A U.S.-based company that is developing a financial service platform that provides real estate investors and borrowers with rental and bridge loans, is looking for a Senior Databricks Engineer. The engineer will be responsible for guiding team members through best practices and cutting-edge data engineering technology. The company equips real estate agents with cutting-edge technologies and immediate funding to fund opportunities. The company has managed to secure more than $155mn in funding so far. 
 
Job Responsibilities:
  • Break down complex projects into actionable steps
  • Oversee the development and implementation of Databricks and Snowflake-based data migration solutions in an AWS environment
  • Develop and maintain real-time data pipelines, data lakes, and data warehouses in collaboration with cross-functional teams to understand data requirements and translate them into technological solutions 
  • Assure that compliance, security, and data quality criteria are met
  • Design and implement data pipelines that turn raw data into actionable insights
Job Requirements:
  • Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
  • At least 5+ years of relevant experience as a data engineer
  • 5+ years of experience with Databricks, Python, and AWS
  • Extensive experience in Stream Processing, DLT (data live tables)
  • Nice to have extensive experience working with PySpark and Snowflake
  • Strong understanding of data modeling, delta lake, data warehousing, and ETL concepts 
  • Demonstrable experience with Stream Processing specifically with Spark Structured Streaming, DLT, etc 
  • Prior experience working with data governance and security best practices 
  • Must have some certifications such as Databricks Lakehouse Data Engineer, Associate, and AWS Certified Developer Associate
  • Some experience with data migration in a regulated industry such as healthcare or finance is nice to have
  • Familiarity with containerization and orchestration technologies such as Kubernetes and Docker is desirable
  • Nice to have some experience with data visualization tools such as Tableau or Looker 
  • Experience with agile development methodologies is preferred
  • Strong communication and leadership skills to effectively collaborate with cross-functional teams
  • Fluent in spoken and written English
Interested in this job?
Apply Now
Other jobs like this
1 day ago
undefined
Not disclosed
undefined
Full time
4 days ago
undefined
Not disclosed
undefined
Full time
5 days ago
undefined
Not disclosed
undefined
Full time
Share this job
modules.web.blog.post.facebookmodules.web.blog.post.twittermodules.web.blog.post.linkedin

Fast track Your Remote Work Career

1

Sign up

Create your profile by sharing your personal and professional details with us.
2

Assessment

Take our online talent assessment for skills and competencies evaluation.
3

Offer

Get matched to in-demand jobs and accelerate your freelance career.

Interested in more opportunities like these?

Join now