Commit bb6b9d7f authored by Jakub Hettler's avatar Jakub Hettler Committed by Tao Feng

Add Elasticsearch service (#91)

* Add Elasticsearch service

* Add search step
parent 5b8db1f6
...@@ -15,6 +15,11 @@ services: ...@@ -15,6 +15,11 @@ services:
- 7687:7687 - 7687:7687
volumes: volumes:
- ./example/docker/neo4j/conf:/conf - ./example/docker/neo4j/conf:/conf
elasticsearch:
image: elasticsearch:6.7.0
container_name: es_amundsen
ports:
- 9200:9200
networks: networks:
- amundsennet - amundsennet
amundsensearch: amundsensearch:
...@@ -22,6 +27,8 @@ services: ...@@ -22,6 +27,8 @@ services:
container_name: amundsensearch container_name: amundsensearch
ports: ports:
- 5001:5000 - 5001:5000
depends_on:
- elasticsearch
networks: networks:
- amundsennet - amundsennet
amundsenmetadata: amundsenmetadata:
......
...@@ -70,7 +70,7 @@ $ docker-compose -f docker-amundsen.yml up ...@@ -70,7 +70,7 @@ $ docker-compose -f docker-amundsen.yml up
``` ```
7. Ingest dummy data into Neo4j by doing the following: 7. Ingest dummy data into Neo4j by doing the following:
* Clone [amundsendatabuilder](https://github.com/lyft/amundsendatabuilder). * Clone [amundsendatabuilder](https://github.com/lyft/amundsendatabuilder).
* Update the `NEO4J_ENDPOINT` in [sample_data_loader.py](https://github.com/lyft/amundsendatabuilder/blob/master/example/scripts/sample_data_loader.py) and replace `localhost` with the IP used for the `default` docker machine. You can see the IP in the `URL` outputted from running `docker-machine ls`. * Update the `NEO4J_ENDPOINT` and `Elasticsearch host` in [sample_data_loader.py](https://github.com/lyft/amundsendatabuilder/blob/master/example/scripts/sample_data_loader.py) and replace `localhost` with the IP used for the `default` docker machine. You can see the IP in the `URL` outputted from running `docker-machine ls`.
* Run the following commands: * Run the following commands:
```bash ```bash
# in ~/<your-path-to-cloned-repo>/amundsendatabuilder # in ~/<your-path-to-cloned-repo>/amundsendatabuilder
...@@ -82,3 +82,4 @@ $ docker-compose -f docker-amundsen.yml up ...@@ -82,3 +82,4 @@ $ docker-compose -f docker-amundsen.yml up
``` ```
8. Verify dummy data has been ingested by viewing in Neo4j by visiting `http://YOUR-DOCKER-HOST-IP:7474/browser/` and run `MATCH (n:Table) RETURN n LIMIT 25` in the query box. You should see two tables -- `hive.test_schema.test_table1` and `dynamo.test_schema.test_table2`. 8. Verify dummy data has been ingested by viewing in Neo4j by visiting `http://YOUR-DOCKER-HOST-IP:7474/browser/` and run `MATCH (n:Table) RETURN n LIMIT 25` in the query box. You should see two tables -- `hive.test_schema.test_table1` and `dynamo.test_schema.test_table2`.
9. View UI at `http://YOUR-DOCKER-HOST-IP:5000/table_detail/gold/hive/test_schema/test_table1` or `/table_detail/gold/dynamo/test_schema/test_table2` 9. View UI at `http://YOUR-DOCKER-HOST-IP:5000/table_detail/gold/hive/test_schema/test_table1` or `/table_detail/gold/dynamo/test_schema/test_table2`
10. View UI at `http://YOUR-DOCKER-HOST-IP:5000` and try to search `test`, it should return some result.
\ No newline at end of file
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment