Comments (4)
The progress is relatively smooth, see the example below:
create source table topic1(
key varchar,
value varchar,
event_time bigint
) with (
type = 'ideal.sylph.plugins.flink.source.TestSource'
);
-- 定义数据流输出位置
create sink table print_table_sink(
key varchar,
cnt long,
window_time varchar
) with (
type = 'ideal.sylph.plugins.flink.sink.PrintSink', -- print console
other = 'demo001'
);
-- 定义 WATERMARK,通常您应该从kafka message中解析出event_time字段
create view TABLE foo
WATERMARK event_time FOR rowtime BY ROWMAX_OFFSET(5000) --event_time 为您的真实数据产生时间
AS
with tb1 as (select * from topic1) --通常这里解析kafka message
select * from tb1;
-- 描述数据流计算过程
insert into print_table_sink
select key,
count(1),
cast(TUMBLE_START(rowtime,INTERVAL '5' SECOND) as varchar)|| '-->'
|| cast(TUMBLE_END(rowtime,INTERVAL '5' SECOND) as varchar) AS window_time
from foo where key is not null
group by key,TUMBLE(rowtime,INTERVAL '5' SECOND)
from sylph.
How do you have any ideas for suggestions? Welcome to the discussion
from sylph.
Already supported
from sylph.
The proctime demo:
create source table topic1(
key varchar,
message varchar, -- json
event_time bigint,
proctime as proctime()
) with (
type = 'test'
);
from sylph.
Related Issues (20)
- The custom kafka data source not support json data map list format parser
- add fine-grained permission control
- windows submit job failure HOT 2
- Fixed a problem that may cause the yarn container to leak when trying to kill a task that is starting. HOT 1
- java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/conf/YarnConfiguration HOT 7
- Does flink-connector-filesystem provide a Source that read partitioned files from HDFS?
- Are you Interested in integrating sylph into Scriptis and Linkis? HOT 3
- 在编译的时候报错
- 编译完成之后如何运行?
- 在IDEA中运行报错 HOT 1
- 支持windows环境吗? HOT 4
- 部署成功后无法登录 HOT 2
- java.lang.NoClassDefFoundError: org/apache/spark/streaming/dstream/DStream HOT 1
- 是否支持窗口函数问题 HOT 3
- 什么时候更新到flink1.10? HOT 1
- AccessControlException): Permission denied: user=kkk HOT 1
- idea下运行报错 HOT 3
- flink_1.9分支运行任务报错 HOT 1
- 本地运行没有日志
- flink1.11.1 运行报 配置参数的问题
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sylph.