Containers for airflow and dockers

Question

I run airflow in AWS ECS containers, 1 scheduler, 2 web servers and several celery workers.

From what I saw, the only thing that affects when they run in containers is that web servers cannot access the workers port on 8793 to retrieve logs from workers.

Is this just what gets affected when they run in containers?

Answer 1

Yes, because you can only display one port from the docker container to host the node instance. I use a similar setting, and logs are the only major issue I have encountered. However, there are different ways to solve this problem. You use other logging services in the container that insert the logs into Cloudwatch or FLuentdb, etc.