Kafka Engineer

Job Description

An employer is looking for a Kafka Engineer to sit remotely.

The candidate will be responsible for performing Kafka cluster builds, including design, infrastructure planning, High Availability and Disaster Recovery

Implementing wire encryption using SSL, authentication using SASL/LDAP & authorization using Kafka ACLs in Zookeeper.

Creating connect cluster and connector deployment.

Good understanding of Schemas and schema registry

Help maintain current Kafka clusters by performing upgrade, performance tuning, monitoring setup, adding new features, etc.

Research new features and conduct proof of concept installation and testing.

Ability to work with various infrastructure, development and administration teams.

Support of Kafka in On-Premise and Cloud AWS

Help/Support Application Teams with respect to their Kafka Implementation and Issue triage

Work with Vendor partners to open cases and work with them to resolution

Work with security team to remediate product vulnerabilities

Work with application teams to gather requirements and understand the design and help them with the build path to production

Work with application teams to do performance and resiliency testing

Implementing best practices and work with product owners to implement the roadmap

Good understanding of provisioning resources in AWS and/or Azure

Creating the ec2 instances, EBS volumes and security groups

Basic understanding of networking and load balancing, okta integration

Basic automation skills using shell scripting, ansible and terraform

Documenting the best practices

Team player

Have hands on experience in the following: create topics, grant permissions, offset reset, troubleshooting issues, upgrade cluster, installing various Kafka components via ansible scripts (broker, zoo keeper, connect, schema registry, KSQL)

Familiar with writing/updating ansible scripts.

Experience with research and POC of new features/technology

AWS/Azure experience

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to ~~~ .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: ~~~/ .

Skills and Requirements

4+ years of Kafka experience

Strong automation experience with Ansible and Terraform

Experience on the public cloud (AWS and Azure)

Experience supporting multiple clusters and performing cluster builds null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to ~~~.