yahoo / hive-funnel-udf Goto Github PK

When the dataset is small, the results are accurate, but when the amount of data becomes larger, the results of the funnel function become inaccurate

For example:

funnel(action, timestamp, array('signup_page', 'email_signup'),
                          array('confirm_button'),
                          array('submit_button')

Should have support to write as:

funnel(action, timestamp, array('signup_page', 'email_signup'),
                          'confirm_button',
                          'submit_button')

os environment
hive version:
Hive 1.1.0-cdh5.5.2
cdh version:
cdh 5.5.2

when i query one day like:

select ouid, funnel(tag1, game_time, array('activity'), array('yaozujianglin'), array('huangjinyuchang')) as funnel from sscq.odl_act_detail_info_sscq_qq where ds = '2016-12-17' group by ouid order by ouid asc

one ouid is :
000000000000000000000000001EC76C [0,0,0]

but i only query one id:
select ouid, funnel(tag1, game_time, array('activity'), array('yaozujianglin'), array('huangjinyuchang')) as funnel from sscq.odl_act_detail_info_sscq_qq where ds = '2016-12-17' and ouid = '000000000000000000000000001EC76C' group by ouid order by ouid asc
result is different.
000000000000000000000000001EC76C [1,0,0]

Specify how much time a user has to complete the funnel from the moment they enter it.

Stored funnels can be converted into integers, where 0 is match to funnel 0, 1 is match to funnel 1, etc.

This will greatly reduce the storage size of the funnels, speeding up all later steps.

It may be possible to add vectorized query support, which would increase performance.