Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
O
orders-monitoring-dashboard
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
Ramakanth Dhane
orders-monitoring-dashboard
Commits
0a74b7ae
Commit
0a74b7ae
authored
5 years ago
by
Ramakanth Dhane
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Added server ports and removed spark main method
parent
aa7f2c24
Changes
6
Show whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
26 additions
and
6 deletions
+26
-6
application.properties
...heckout-service/src/main/resources/application.properties
+1
-0
application.properties
omd-notifications/src/main/resources/application.properties
+1
-1
OmdStreamProcessorApplication.java
...ain/java/com/nisum/omd/OmdStreamProcessorApplication.java
+17
-0
OmdKafkaUtility.java
...ain/java/com/nisum/omd/kafka/utility/OmdKafkaUtility.java
+2
-1
OmdSparkStreamService.java
...va/com/nisum/omd/spark/service/OmdSparkStreamService.java
+4
-3
application.properties
...tream-processor/src/main/resources/application.properties
+1
-1
No files found.
omd-checkout-service/src/main/resources/application.properties
View file @
0a74b7ae
server.port
=
8081
app.currency
=
INR
app.shipMethod
=
1
app.customerType
=
01
...
...
This diff is collapsed.
Click to expand it.
omd-notifications/src/main/resources/application.properties
View file @
0a74b7ae
server.port
=
808
9
server.port
=
808
3
bootstrap-server
=
localhost:9092
group-id
=
my-order-json-data-group
auto-offset-reset-config
=
earliest
...
...
This diff is collapsed.
Click to expand it.
omd-stream-processor/src/main/java/com/nisum/omd/OmdStreamProcessorApplication.java
View file @
0a74b7ae
package
com
.
nisum
.
omd
;
import
org.springframework.boot.CommandLineRunner
;
import
org.springframework.boot.SpringApplication
;
import
org.springframework.boot.autoconfigure.SpringBootApplication
;
import
org.springframework.context.ApplicationContext
;
import
org.springframework.context.annotation.Bean
;
import
com.nisum.omd.spark.service.OmdSparkStreamService
;
@SpringBootApplication
public
class
OmdStreamProcessorApplication
{
...
...
@@ -9,5 +14,17 @@ public class OmdStreamProcessorApplication {
public
static
void
main
(
String
[]
args
)
{
SpringApplication
.
run
(
OmdStreamProcessorApplication
.
class
,
args
);
}
@Bean
public
CommandLineRunner
commandLineRunner
(
ApplicationContext
ctx
)
{
return
args
->
{
System
.
out
.
println
(
"Let's inspect the beans provided by Spring Boot:"
);
OmdSparkStreamService
sparkService
=
ctx
.
getBean
(
OmdSparkStreamService
.
class
);
sparkService
.
sparkInvokation
();
};
}
}
This diff is collapsed.
Click to expand it.
omd-stream-processor/src/main/java/com/nisum/omd/kafka/utility/OmdKafkaUtility.java
View file @
0a74b7ae
...
...
@@ -3,7 +3,8 @@ package com.nisum.omd.kafka.utility;
public
class
OmdKafkaUtility
{
public
static
final
String
APPLICATION_NAME
=
"Streaming Order DStream"
;
public
static
final
String
HADOOP_HOME_DIR_VALUE
=
"C:/winutils"
;
//public static final String HADOOP_HOME_DIR_VALUE = "C:/winutils";
public
static
final
String
HADOOP_HOME_DIR_VALUE
=
"/usr/rdhane/server/spark-3.0.0-preview2-bin-hadoop2.7/bin"
;
public
static
final
String
RUN_LOCAL_WITH_AVAILABLE_CORES
=
"local[*]"
;
public
static
final
int
BATCH_DURATION_INTERVAL_MS
=
50000
;
public
static
final
String
KAFKA_BROKERS
=
"localhost:9092"
;
...
...
This diff is collapsed.
Click to expand it.
omd-stream-processor/src/main/java/com/nisum/omd/spark/service/OmdSparkStreamService.java
View file @
0a74b7ae
...
...
@@ -11,12 +11,14 @@ import org.apache.spark.streaming.api.java.JavaStreamingContext;
import
org.apache.spark.streaming.kafka010.ConsumerStrategies
;
import
org.apache.spark.streaming.kafka010.KafkaUtils
;
import
org.apache.spark.streaming.kafka010.LocationStrategies
;
import
org.springframework.stereotype.Service
;
import
java.util.Arrays
;
import
java.util.Collection
;
import
java.util.Collections
;
import
java.util.Map
;
@Service
public
class
OmdSparkStreamService
{
private
static
final
Map
<
String
,
Object
>
KAFKA_CONSUMER_PROPERTIES
;
static
{
...
...
@@ -27,13 +29,12 @@ public class OmdSparkStreamService {
private
static
final
Collection
<
String
>
TOPICS
=
Collections
.
unmodifiableList
(
Arrays
.
asList
(
OmdKafkaUtility
.
KAFKA_TOPIC
));
public
static
void
main
(
String
[]
args
)
throws
InterruptedException
{
public
void
sparkInvokation
(
)
throws
InterruptedException
{
JavaInputDStream
<
ConsumerRecord
<
String
,
String
>>
orderStream
=
null
;
System
.
setProperty
(
"hadoop.home.dir"
,
OmdKafkaUtility
.
HADOOP_HOME_DIR_VALUE
);
// System.setProperty("hadoop.home.dir", OmdKafkaUtility.HADOOP_HOME_DIR_VALUE);
SparkConf
conf
=
new
SparkConf
()
.
setMaster
(
OmdKafkaUtility
.
RUN_LOCAL_WITH_AVAILABLE_CORES
)
...
...
This diff is collapsed.
Click to expand it.
omd-stream-processor/src/main/resources/application.properties
View file @
0a74b7ae
server.port
=
8084
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment