Commit 33f6028a authored by bolkedebruin's avatar bolkedebruin Committed by Tao Feng

Create docker-compose with Apache Atlas (#108)

* Add Atlas as config option

* Add Amundsen example based on Atlas

* Add logging of where backend reside
parent 9b8b0a93
...@@ -10,7 +10,7 @@ Amundsen is a metadata driven application for improving the productivity of data ...@@ -10,7 +10,7 @@ Amundsen is a metadata driven application for improving the productivity of data
It includes three microservices and a data ingestion library. It includes three microservices and a data ingestion library.
- [amundsenfrontendlibrary](https://github.com/lyft/amundsenfrontendlibrary): Frontend service which is a Flask application with a React frontend. - [amundsenfrontendlibrary](https://github.com/lyft/amundsenfrontendlibrary): Frontend service which is a Flask application with a React frontend.
- [amundsensearchlibrary](https://github.com/lyft/amundsensearchlibrary): Search service, which leverages Elasticsearch for search capabilities, is used to power frontend metadata searching. - [amundsensearchlibrary](https://github.com/lyft/amundsensearchlibrary): Search service, which leverages Elasticsearch for search capabilities, is used to power frontend metadata searching.
- [amundsenmetadatalibrary](https://github.com/lyft/amundsenmetadatalibrary): Metadata service, which leverages Neo4j as the persistent layer, to provide various metadata. - [amundsenmetadatalibrary](https://github.com/lyft/amundsenmetadatalibrary): Metadata service, which leverages Neo4j or Apache Atlas as the persistent layer, to provide various metadata.
- [amundsendatabuilder](https://github.com/lyft/amundsendatabuilder): Data ingestion library for building metadata graph and search index. - [amundsendatabuilder](https://github.com/lyft/amundsendatabuilder): Data ingestion library for building metadata graph and search index.
Users could either load the data with [a python script](https://github.com/lyft/amundsendatabuilder/blob/master/example/scripts/sample_data_loader.py) with the library Users could either load the data with [a python script](https://github.com/lyft/amundsendatabuilder/blob/master/example/scripts/sample_data_loader.py) with the library
or with an [Airflow DAG](https://github.com/lyft/amundsendatabuilder/blob/master/example/dags/sample_dag.py) importing the library. or with an [Airflow DAG](https://github.com/lyft/amundsendatabuilder/blob/master/example/dags/sample_dag.py) importing the library.
......
...@@ -44,6 +44,8 @@ def create_app(config_module_class: str, template_folder: str = None) -> Flask: ...@@ -44,6 +44,8 @@ def create_app(config_module_class: str, template_folder: str = None) -> Flask:
logging.basicConfig(format=app.config.get('LOG_FORMAT'), datefmt=app.config.get('LOG_DATE_FORMAT')) logging.basicConfig(format=app.config.get('LOG_FORMAT'), datefmt=app.config.get('LOG_DATE_FORMAT'))
logging.getLogger().setLevel(app.config.get('LOG_LEVEL')) logging.getLogger().setLevel(app.config.get('LOG_LEVEL'))
logging.info('Created app with config name {}'.format(config_module_class)) logging.info('Created app with config name {}'.format(config_module_class))
logging.info('Using metadata service at {}'.format(app.config.get('METADATASERVICE_BASE')))
logging.info('Using search service at {}'.format(app.config.get('SEARCHSERVICE_BASE')))
app.register_blueprint(blueprint) app.register_blueprint(blueprint)
app.register_blueprint(announcements_blueprint) app.register_blueprint(announcements_blueprint)
......
version: '3'
services:
atlas:
image: wbaa/rokku-dev-apache-atlas:latest
container_name: atlas_amundsen
ports:
- 21000:21000
networks:
- amundsennet
environment:
- ATLAS_PROVISION_EXAMPLES=true
amundsensearch:
image: amundsen-search:latest
container_name: amundsensearch
ports:
- 5001:5000
#depends_on:
# - elasticsearch
networks:
- amundsennet
amundsenmetadata:
image: amundsen-metadata:latest
container_name: amundsenmetadata
depends_on:
- atlas
ports:
- 5002:5000
networks:
- amundsennet
environment:
- CREDENTIALS_PROXY_USER=admin
- CREDENTIALS_PROXY_PASSWORD=admin
- PROXY_HOST=atlas
- PROXY_PORT=21000
- PROXY_CLIENT=ATLAS
amundsenfrontend:
image: amundsen-frontend:latest
container_name: amundsenfrontend
depends_on:
- amundsenmetadata
- amundsensearch
ports:
- 5000:5000
networks:
- amundsennet
environment:
- METADATASERVICE_BASE=http://amundsenmetadata:5000
- SEARCHSERVICE_BASE=http://amundsensearch:5000
networks:
amundsennet:
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment