Ops-Talks #05 - Kafka

Kafka Listeners

While developing in a Docker environment it’s important to get a good understanding of Kafka listeners / advertised listeners. This notion is really well explained in this article: Kafka Listeners Explained

You need to set advertised.listeners (or KAFKA_ADVERTISED_LISTENERS if you’re using Docker images) to the external address (host/IP) so that clients can correctly connect to it. Otherwise, they’ll try to connect to the internal host address—and if that’s not reachable, then problems ensue.

You can also use this Github repository to play around with this notion:

Ops-Talks #03 - K8s Vs ECS

1.1 K8s Vs ECS

Kubernetes is a portable, extensible, open-source platform for managing containerized workloads and services. It is first and foremost a REST API

  • Features: (non-exhaustive)
    • 🔹 Service discovery and load balancing
    • 🔹 Storage orchestration
    • 🔹 Automated rollouts and rollbacks
    • 🔹 Self-healing
    • 🔹 Secret and configuration management
    • 🔹 kubectl as a way to interact with the cluster

ECS is a fully managed container orchestration service

  • Features:
    • 🔸 Integrated with AWS services
    • 🔸 Easy to pick up / Entry level to container world
    • 🔸 Ease of use from GUI + Serveless experience with Fargate
    • 🔸 ecs-cli and aws-cli as a way to interact with the cluster