Salesforce Staff Software Engineer Data Engineering 

United States, California, San Francisco 

216057501

Job Category

Software Engineering

Job Details

Slack is looking for a staff software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Data Warehouse with both streaming and batch approaches. Currently, our infrastructure handles 180PB+ of storage, processes ~1T records a day, 400+ data pipelines and 1000+ Active Airflow DAGs. As Slack’s data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies.

What you will be doing

• Design and develop highly scalable and resilient streaming and batch services for ingesting and processing structured and unstructured datasets

• Design and implement Slack’s Lakehouse solutions and enable production use cases for customers

• Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration).

• Improve the data quality and reliability of the pipelines through proper monitoring and alerting.

• Comfortably collaborate with cross functional partners and lead technical initiatives independently end to end.

• Be a role model and a multiplier, coaching and mentoring other engineers across the org.

• Write, review, or provide feedback on a technical design proposal from others.

What you should have

• 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent

• You have good experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3, etc.

• You are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalent

• You are skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, etc.

• You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests.

• You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders

• You have high growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them

• Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience

Unleash Your Potential

When you join Salesforce, you’ll be limitless in all areas of your life. Our benefits and resources support you to find balance and

, and our AI agents accelerate your impact so you can

If you require assistance due to a disability applying for open positions please submit a request via this.

Posting Statement

to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records. For Washington-based roles, the base salary hiring range for this position is $211,500 to $306,600. For California-based roles, the base salary hiring range for this position is $230,800 to $334,600.