Commit 18624e35 authored by Balasubrahmanyam Gudavalli's avatar Balasubrahmanyam Gudavalli

Merge remote-tracking branch 'origin/master'

parents 2d0147f2 b87224bf
# Inventory Process API
1. inventory-process-api will read inventory json file via spark structured streaming (readStream) and write (writeStream) all records to kafka topic with specific batchId. This event will be triggered via POST method by uploading json file.
2. This API will consume the kafka topic via spark structured streaming (readStream) and write (writeStream) transformed records to mongo collection. This event will be triggered via GET call by passing batchId
3. Additionally GET method will return processed data with CollectionAccumulator concept in spark.
4. Postman script and input json files are available in src/main/resources/postman folder.
Technologies Used :
1. Spring boot
2. Java8
3. Spark Core
4. Spark Sql
5. Spark kafka Connector
5. Spring Webflux
\ No newline at end of file
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment