Job responsibilities
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
- Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
- Work closely with data scientists and analysts to comprehend data requirements and deliver solutions that align with business objectives
- Optimize and troubleshoot data workflows to ensure high performance and reliability
- Implement best practices for data governance, security, and compliance
- Utilize Databricks for advanced data processing and analytics tasks, while monitoring and managing data infrastructure to ensure scalability and cost effectiveness
- Document data processes and workflows to promote transparency and facilitate knowledge sharin
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
- Contributes to software engineering communities of practice and events that explore new and emerging technologies
- Adds to team culture of diversity, opportunity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 3+ years applied experience
- Hands-on practical experience in system design, application development, testing, and operational stability
- Design and implement data solutions on AWS, utilizing services such as S3, EKS/ECS, Lambda
- Strong development experience in Python or Java
- Expertise in PySpark/Spark and familiarity with big data frameworks
- Hands-on experience with AWS services and cloud-based data solutions
- Experience with database technologies such as SQL, PostgreSQL, or DynamoDB
- Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
- Overall knowledge of the Software Development Life Cycle
- Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
- Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
Preferred qualifications, capabilities, and skills
- Experience with data warehousing solutions and ETL processes
- Proficiency in data visualization tools and techniques
- Familiarity with Databricks and its ecosystem