kajanm / dsvl Goto Github PK

View Code? Open in Web Editor NEW

2.0 6.0 3.0 2.53 MB

Distributed Systems Virtual Lab

License: MIT License

Java 48.12% CSS 27.34% JavaScript 0.50% HTML 24.04%

distributed-systems udp spring-boot tcp

dsvl's Introduction

To build and run the application

Instructions to build with an IDE is described here.

Ensure you have Java 8 installed
Open terminal or command line and navigate to the flood directory
Run ./gradlew bootJar (it is not necessary to have Gradle installed in your system)

You will get an output similar to below

Starting a Gradle Daemon (subsequent builds will be faster)

BUILD SUCCESSFUL in 6s
3 actionable tasks: 3 up-to-date

Run java -jar build/libs/flood-0.0.1-SNAPSHOT.jar --node.port=44444 --server.port=8080

If the node starts correctly you will see log messages like below

2018-10-19 16:29:11.787  INFO 15771 --- [           main] com.dsvl.flood.FloodApplication          : Started FloodApplication in 3.403 seconds (JVM running for 3.948)
2018-10-19 16:29:11.789  INFO 15771 --- [           main] com.dsvl.flood.Registrant                : Attempting to register with the bootstrap server
2018-10-19 16:29:11.794  INFO 15771 --- [           main] com.dsvl.flood.UdpHelper                 : Sent UDP message to 127.0.0.1:55555 0029 REG 127.0.0.1 44445 dsvl
2018-10-19 16:29:11.796  INFO 15771 --- [           main] com.dsvl.flood.UdpHelper                 : Received UDP message from 127.0.0.1:55555 0044 REGOK 2 127.0.0.1 45555 127.0.0.1 44444
2018-10-19 16:29:11.796  INFO 15771 --- [           main] c.d.f.service.impl.RegisterServiceImpl   : Successfully registered with the bootstrap server

If you want to start multiple node instance, run the same command with different node.port and server.port values

dsvl's People

Contributors

Stargazers

Watchers

Forkers

kasthurimahadeva thilan7 suksw

dsvl's Issues

send ping pong messages to neighbours and adjust the neighbour table accordingly

implementation for optional TTL

create a builder class to build REG, JOIN, ... UDP messages

propagate the search to other nodes

When a search query is received and the file is not available in that node, check for appropriate conditions(duplicate, TTL) and forward the message to the neighbor nodes.

register node with the bootstrap server

properly parse incoming UDP message

REGOK specific implementation should come under

DSVL/flood/src/main/java/com/dsvl/flood/service/impl/RegisterServiceImpl.java

Lines 27 to 31 in 47ab96b

    
           if (UdpHelper.receiveMessage(nodeUdpPort, 2000) != null) { 
        
               // TODO: Subhashini, REGOK specific implementation should go here 
        
               logger.info("Successfully registered with the bootstrap server"); 
        
               return true; 
        
           }

for other types of messages the implementation should be under

DSVL/flood/src/main/java/com/dsvl/flood/UdpServer.java

Lines 58 to 61 in 47ab96b

    
           if (incomingPacket.getData().length != 0) { 
        
               // TODO: process incoming UDP message 
        
               String receivedData = new String(incomingPacket.getData(), 0, incomingPacket.getLength()); 
        
               logger.info("Received UDP message from {}:{} {}", incomingPacket.getAddress().getHostAddress(), incomingPacket.getPort(), receivedData);

initiate TCP connection to notify the existence of queried file

Unregistering with the bootstrap server failed

2018-12-06 14:12:14.496 DEBUG 18461 --- [  restartedMain] com.dsvl.flood.UdpServer                 : Stopping ever running UDP server port at 45555
2018-12-06 14:12:14.524 ERROR 18461 --- [io-8081-exec-10] com.dsvl.flood.UdpHelper                 : Error while sending or receiving packet

java.net.BindException: Address already in use (Bind failed)
	at java.net.PlainDatagramSocketImpl.bind0(Native Method) ~[na:1.8.0_191]
	at java.net.AbstractPlainDatagramSocketImpl.bind(AbstractPlainDatagramSocketImpl.java:93) ~[na:1.8.0_191]
	at java.net.DatagramSocket.bind(DatagramSocket.java:392) ~[na:1.8.0_191]
	at java.net.DatagramSocket.<init>(DatagramSocket.java:242) ~[na:1.8.0_191]
	at java.net.DatagramSocket.<init>(DatagramSocket.java:299) ~[na:1.8.0_191]
	at java.net.DatagramSocket.<init>(DatagramSocket.java:271) ~[na:1.8.0_191]
	at com.dsvl.flood.UdpHelper.sendAndReceiveMessage(UdpHelper.java:102) ~[classes/:na]
	at com.dsvl.flood.service.impl.UnregisterServiceImpl.unregister(UnregisterServiceImpl.java:18) [classes/:na]
	at com.dsvl.flood.Node.unregister(Node.java:355) [classes/:na]
	at com.dsvl.flood.Node.leaveNetwork(Node.java:323) [classes/:na]
	at com.dsvl.flood.controller.LeaveController.leave(LeaveController.java:15) [classes/:na]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_191]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_191]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_191]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_191]
	at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:209) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:136) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:102) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:891) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:797) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:991) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:925) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:974) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:877) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:661) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:851) [spring-webmvc-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:742) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) [tomcat-embed-websocket-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:96) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(HttpPutFormContentFilter.java:109) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) [spring-web-5.0.9.RELEASE.jar:5.0.9.RELEASE]
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:800) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:806) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1498) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_191]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_191]
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) [tomcat-embed-core-8.5.34.jar:8.5.34]
	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_191]

2018-12-06 14:12:14.525  INFO 18461 --- [io-8081-exec-10] com.dsvl.flood.Node                      : Not able to unregister from bootstrap server. Skipping..
2018-12-06 14:12:14.538  INFO 18461 --- [io-8081-exec-10] com.dsvl.flood.UdpHelper                 : Sent UDP message to 10.10.29.101:45556 0028 LEAVE 10.10.2.160 45555
2018-12-06 14:12:14.552  INFO 18461 --- [io-8081-exec-10] com.dsvl.flood.UdpHelper                 : Received UDP message from 10.10.29.101:56614 0014 LEAVEOK 0
2018-12-06 14:12:14.553  INFO 18461 --- [io-8081-exec-10] com.dsvl.flood.Node                      : Informed neighbour 10.10.29.101/10.10.29.101:45556 about leaving
2018-12-06 14:12:14.553  INFO 18461 --- [io-8081-exec-10] com.dsvl.flood.Node                      : Finished informing the neighbours. Leaving gracefully.

randomly join with the network

Use Set to hold File data instead of List to avoid duplicates

take ip address of the system instead of taking as localhost

search if the queried file name exists in the node's local file store

initiate the search from a node

Allow nodes to listen to UDP messages

This server receives log messages from all other nodes, including the bootstrap server and push them to the front end in real time so that it is easy to visualize what is going on in the whole network

create skeleton of a node

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

	if (UdpHelper.receiveMessage(nodeUdpPort, 2000) != null) {
	// TODO: Subhashini, REGOK specific implementation should go here
	logger.info("Successfully registered with the bootstrap server");
	return true;
	}

	if (incomingPacket.getData().length != 0) {
	// TODO: process incoming UDP message
	String receivedData = new String(incomingPacket.getData(), 0, incomingPacket.getLength());
	logger.info("Received UDP message from {}:{} {}", incomingPacket.getAddress().getHostAddress(), incomingPacket.getPort(), receivedData);