Icon menu dark

Software Engineer, Kafka Infrastructure

SF
Are you passionate about building large scale data processing systems and are you motivated to make an impact in creating a robust and scalable data platform? We'd love to talk to you! You will be a part of an early team that builds the data transport, collection and queueing layer. You will own frameworks and services that make data a first-class citizen at Lyft, powering decisions and applications. You will help shape the vision and architecture of Lyft’s next generation data infrastructure, making it easy for developers to build data-driven products and features to delight millions of our drivers and passengers.
Those drivers and passengers use our mobile applications (iOS and Android), which are powered by our fleet of services (Python, Go, and PHP). You will be responsible for tackling the complicated and fun problems of generating and collecting data from those sources, transporting that data into our streaming tier, and queueing it durably for downstream consumers. You’ll get to work across the entire Lyft organization, collaborating closely with engineers, product managers, analysts, and data scientists.
We are a set of engineers constantly striving to create an amazing experience for our customers and ourselves, and we believe data brings everything together. We build and operate the data platform used by the rest of the company for stream and batch computation. We power dashboards and machine learning models used to grow and optimize our multi-billion dollar two-sided marketplace of drivers and passengers. You will be a part of an experienced engineering team and work with passionate leaders on challenging distributed systems problems. We regard culture and trust highly and believe you will add positively to it in your own way.

What you'll do:

  • Design and own the way data is generated, collected, ingested, and stored for the entirety of Lyft
  • Collaborate with engineers, product managers, analysts, and data scientists to make sure all decisions at Lyft can be informed correctly by data
  • Build and maintain the core event persistence layer (Kafka) that stores every single event (billions and billions) collected by Lyft
  • Build strong tests and the frameworks to support them
  • Desired Skills:

  • 3+ years of software engineering
  • 3+ years of experience building software on top of streaming infrastructure (Kafka, Kinesis, Flink, Storm, Beam, etc.)
  • 3+ years of experience operating and maintaining Kafka at scale
  • Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms)
  • Demonstrated skills in delivering high quality code
  • Lyft is an EEO employer that actively pursues and hires a diverse workforce, and pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
    Save
    Apply
    Verified open
    Posted by employer

    Error

    There was an error handling your request. Please make sure you're online.

    Retry