Staff Software Engineer - Observability Platform (Druid)

Description

With Confluent, organisations can harness the full power of continuously flowing data to innovate and win in the modern digital world. We have a purpose that drives us to do better every day – we're creating an entirely new category within data infrastructure - data streaming. This technology will allow every organisation to create experiences and use the power of data in ways that profoundly impact the way we all live. This impact is our purpose and drives us to do better every day.

One Confluent. One team. One Data Streaming Platform.

Data Connects Us.

About the Role:

Observability Platform : 
Observability Platform derives intelligent alerts out of the Logs and Metrics. It is composed of multiple areas and domains - Apache Druid, Logging Platform. This is a unique domain which consists of a distributed system, application layer, platform layer (APIs). This domain helps establish Observability as a key pillar for Confluent’s long term success and a reason for customers to buy Confluent over competition.

Challenges in this domain:

• Ingesting metrics into Apache Druid in real-time.
• Scaling Apache Druid for cloud-scale operations
• Optimising performance to handle high query per second (QPS) rates.
• Addressing the challenges associated with query and cluster sharding.

What You Will Do:

• Solve critical distributed system problems around Apache Druid.
• Develop critical features around Apache Druid.
• Solve challenging problems that will disrupt stream processing space.
• Build a product that will leverage the scale of resources available in cloud and on-prem environments.
• Conceive innovative new solutions for our customers, at the intersection of multiple fields: stream processing, Big Data and analytics.
• Mentor a team of high-performing engineers and leads, helping them to continue in growing their skill set through hands-on experience and mentorship.
• Provide timely and productive feedback, encourage a growth mindset, and advise team members in setting and working toward personal development goals.
• Nurture a culture of excellence on the team through a focus on hiring, communication, execution, and work quality.
• Collaborate with others in engineering and product leadership to create the long-term technical and product roadmap and quarterly deliverables for your team.
• Effectively communicate the roadmap and strategy within the team and across the organization.
• Create and manage processes that enable the team to do its best work

What You Will Bring:

• Minimum of 12+ years of software development experience.
• Familiarity with Apache Druid and Apache Kafka or similar high-scale distributed data systems.
• Experience in enterprise-scale software development.
• Experience running production services in the cloud.
• Experience fixing scalability and reliability issues at Cloud scale
• Ability to ensure a high hiring bar, keep engineers motivated, coach/mentor and handle performance management issues
• Experience running large stateful data systems and production services in the cloud
• Strong fundamentals in distributed systems design and development. Solid fundamentals in concurrent and multi-threading programming.
• A great track record of shipping features and hitting deadlines consistently.
• Ability to move fast, build in increments, and iterate. A sense of urgency, a mindset towards achieving results, and excellent prioritization skills.
• Ability to anticipate future technical needs for the product and craft plans to realize them
• Ability to influence the team, peers and upper management using effective communication and collaborative techniques
• Focus on building and maintaining a culture of collaboration within the team
• Degree in Computer Science, Engineering or equivalent experience. An advanced degree in computer science is preferred.

What Gives You an Edge: 

• Experience in open-source development
• Experience developing Apache Druid
• Experience developing/using Apache Kafka

Come As You Are

At Confluent, equality is a core tenet of our culture. We are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact. Employment decisions are made on the basis of job-related criteria without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by applicable law.

Click HERE to review our Candidate Privacy Notice which describes how and when Confluent, Inc., and its group companies, collects, uses, and shares certain personal information of California job applicants and prospective employees.

#LI-Remote