🏢 Summary: Lead the design and development of a scalable, cloud-native data processing platform using Apache Spark and Databricks. The role covers full software development lifecycle ownership, architectural leadership, and implementation of enterprise-scale distributed data solutions. It also involves driving innovation with AI/ML and ensuring performance, security, and reliability of data systems.
🗂️ Requirements: BS/MS in Computer Science or related field, 10+ years experience in large-scale data processing and distributed computing, Hands-on experience with Apache Spark and Databricks, Strong programming skills in Java, Strong programming skills in Python, Experience with UNIX/Linux and Bash scripting, Experience with event-driven architecture, Experience with real-time data streaming systems, Experience with OLAP and OLTP databases, Knowledge of distributed systems concepts, Experience designing cloud-native enterprise solutions, Understanding of data security principles, Experience with batch and real-time data processing, Experience with CI/CD and DevOps practices
📃 Skills: Spark, Databricks, Java, Python, UNIX, Linux, Bash, Kafka, SQS, Kinesis, OLAP, OLTP, Scala, MATLAB, MCR, CI/CD, DevOps, AI, MachineLearning, Encryption
🏢 Description: Who we are looking for We are looking for an experienced Application Development Lead with deep technical expertise to join State Street Data Intelligence Team. The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end-to-end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies. What you will be responsible for The candidate will be deeply involved in all phases of the software development lifecycle, including scope definition, requirements analysis, functional and technical design, application implementation, unit testing, production deployment and support. Provide architectural direction across development teams and lead technical design reviews. Participate in strategic planning, technical roadmap development, and system architecture reviews. Ensure all technical solutions exhibit higher level of efficiency, performance, security, scalability, and reliability. Collaborate with cross-functional teams to define technical requirements and ensure successful project execution. Leverage AI and Machine Learning tools to drive platform innovation. Stay current with industry best practices; evaluate emerging tools for strategic benefit. What we value Capability of working independently in all phases of the software development lifecycle (including: scope definition, requirements analysis, functional and technical design, application implementation, unit testing, production deployment and support). Proven track record designing and building cloud-native enterprise-scale data computing solutions. Strong leadership skills, analytical problem-solving skills, quick to learn and adapt. Self-motivated, creative problem solver, organized, collaborative with excellent communication skills. Education & Preferred Qualifications BS/MS in Computer Science or equivalent field 10+ years of experience in designing and building large scale data processing and distributed computing solutions (Apache Spark, Databricks). Strong programming skills in Java and Python Familiarity with UNIX/Linux and Shell (e.g. Bash) scripting In-depth knowledge of event-driven architecture and real-time data streaming (e.g. Kafka, AWS SQS, Kinesis). Strong experience OLAP and OLTP Databases and storage solutions. Additional advantage Functional programming experience (e.g. Scala) Hands-on experience with MATLAB and MCR. Hands-on experience with CI/CD and DevOps. Successful candidates can demonstrate Deep understanding of distributed system concepts like concurrency, fault-tolerance, and data consistency models. Deep understanding of cloud-native and system integration design patterns, with the ability to apply patterns to build scalable, maintainable, and secure cloud applications. Solid understanding of data security principles including encryption, key management, and secure design principles. Strong understanding of application monitoring, observability, and alerting practices to ensure system reliability, performance, and rapid incident response. Strong experience with batch and real-time data processing, focusing on data quality. Hands-on experience with system and application performance optimization. Note: The role requires a minimum of three days per week working from the office Minimum Salary: zł282,000 Annual The minimum salary quoted above applies to the role in the primary location specified. If the candidate ultimately works outside of this primary location, the applicable minimum salary may differ. Salary will be determined based on factors such as the position, type of work performed, individual skills, job description, working hours, diligence, initiative, self-management, length of employment, availability, and the quantity and quality of work delivered, as well as other objective and non-discriminatory criteria relevant to State Street employees. In addition to salary, employees are eligible to be considered for discretionary annual performance-based awards. We Offer: Permanent contract from day one Additional holidays (Birthday Day Off, 3rd and 5th year anniversary Day Off) Gold Medical Package for employees and their families (partner and children) Premium life insurance package and private pension plan Wide range of soft skills training, technical workshops, language classes and development programs Opportunities to volunteer your time to company-driven initiatives, employee networks or organizations of your choice Variety of well-being programs Additional benefits available depending on the seniority of the role About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers Read our CEO Statement State Street's Speak Up Line Załącznik do standardu Whistleblowing i Speak Up SSBI GmbH dla Oddziału w Polsce