Examples for Spark 2.0 release.
sbt clean package
phatak-dev / spark2.0-examples Goto Github PK
View Code? Open in Web Editor NEWExamples of Spark 2.0
spark2.0-examples's Introduction
spark2.0-examples's People
Contributors
Stargazers
Watchers
Forkers
shmhatre giserh shashidharsudi sivajuturu flytrapmind peisun1115 hakanyildiz pra-deep wypb harikrishn chenchals chengat1314 simplyamuthan big-data-laboratory coderxingzhang firatkarakusoglu heihei2015 mindis wuzhongdehua hpf99 eureal tspannhw hamroune ravion vishal2232 eugene-goldberg cikejonas redskycry radari krishnaramya mandalm techyogillc hute37 phani111 zealot-shin moulidn labdoui ram1991 soonpoong-hong anisar r4ravi2008 durgaprasd reddy279 dingdongliang bochuxt erdcpatel sujeetsharma1980 ramanujadasu tkamag kvlprasad bryandsy neil90 bimehta harishrajoori r7raul1984 wtx626 sominalearninghub ishitvyas muhammadzak vktor18 oleiva veejayendraa seshendranath venkat01 amarnath88888 akhilanandbv003 nautiydp an100 akshay-frequence subhraj07 hanks110 shigongxing salman-ghauri hl123123 antojustuz msathiyarajan commandlineconsole whatitslike umardatageek rabindrapal anarasimham sinloong dconger salyh andinh202 qhhan dsreenivasulu benoitdescamps dasaradhs1 sampathsree badrulaff pradhyu cequencer ottoych neo3072 sathishs santoshbk01 matrixlover veeranji0425 venuktanspark2.0-examples's Issues
Question in the blog of structured streaming part 11
Hi @phatak-dev
First, thank you very much for the great effort to write the structured streaming series.
I got a question: in http://blog.madhukaraphatak.com/introduction-to-spark-structured-streaming-part-11/
Running the Example
Enter the below records in socket console. These are records for AAPL with time stamps.
First Event
The first records is for time Wed, 27 Apr 2016 11:34:22 GMT.
1461756862000,"aapl",500.0
Spark outputs below results which indicates start of window
Batch: 0
+---------------------------------------------+----------+
|window |sum(value)|
+---------------------------------------------+----------+
|[2016-04-27 17:04:20.0,2016-04-27 17:04:30.0]|500.0 |
+---------------------------------------------+----------+
The first record is 2016-04-27 11:34:22, why in batch 0 the window interval is
2016-04-27 17:04:20.0,2016-04-27 17:04:30.0, I thought it should be around 2016-04-27 11:34:22,
Are there algorithms in the project?
Are there algorithms in the project?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.