We are seeking a Senior Data Engineer to develop and maintain scalable data pipelines using Python and PySpark. The ideal candidate will have experience with Big Data Technologies, Databases, and Cloud Platforms. This role requires strong technical skills and collaboration with teams on cloud deployments, CI/CD, and production support.
Key Highlights
Key Responsibilities
Technical Skills Required
Benefits & Perks
Job Description
Data Engineer ($80-85K+ Benefits) + H1b Transfers are Workable
Dallas, TX
Fulltime (Permanent)
5 Positions
Job Description:
Searching for Data Science roles that provide visa sponsorship? Connect with international employers through Data Science Jobs with Visa Sponsorship opportunities actively seeking talented professionals.
Experience: 5 Years
Core Skills:
- Data Engineering: Data Pipelines, Data Processing, ETL, Large-Scale Data Processing
- Big Data Technologies: Python, PySpark, Apache Spark, Databricks, Delta Lake
- Databases: PostgreSQL, MongoDB, Redis, SQL, NoSQL
- Streaming & Real-Time Processing: Kafka, Kafka Streaming, Real-Time Data Processing
- Cloud Platforms: Azure, AWS, Cloud Data Services
- Performance Optimization: Data Partitioning, Performance Tuning, In-Memory Optimization
- DevOps & Deployment: CI/CD Pipelines, Production Deployment, Linux, Unix
- APIs & Architecture: REST APIs, Application Development, System Design, Software Architecture
- Platform & Security: Multi-User Data Platforms, Access Management
- GenAI & AI Concepts: LLM Workflows, Prompt Versioning, Evaluation Frameworks
Explore our comprehensive directory of visa sponsorship jobs from employers worldwide who are ready to sponsor talented international professionals.
Interested in opportunities specifically in United State? Discover our dedicated Visa Sponsorship Jobs in United State page featuring roles from top employers in this location.
Key Responsibilities:
- Develop and maintain scalable data pipelines using Python and PySpark.
- Work with Databricks and Delta Lake for data processing and optimization.
- Design and manage SQL/NoSQL database integrations and workflows.
- Support real-time streaming solutions using Kafka or similar frameworks.
- Optimize data processing performance and partitioning strategies.
- Collaborate with teams on cloud deployments, CI/CD, and production support.
- Integrate REST APIs and support application-level data requirements.
- Contribute to GenAI and LLM-based workflow initiatives where applicable.
Similar Jobs
Explore other opportunities that match your interests
Senior Principal AI/ML Engineer
palo alto networks unit 42
Senior AI Data Engineer
Deloitte
VIE Analyst, People Analytics