Allow for infinite crawling about sce HOT 3 CLOSED

When Ctrl+C is hit, can we show them a message? eg, "It may take up to 30 minutes to stop gracefully. If you want to force a stop (and potentially lose some of the collected data), press Ctrl+C again." Wayne Moses Burke, MS Cognizant Engineer Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Mailstop: 168-527 E-mail: [email protected]<mailto:[email protected]> On 06/15/2017 01:37 PM, Sujen Shah wrote: @wmburke<https://github.com/wmburke> @giuseppetotaro<https://github.com/giuseppetotaro>, by default we plan to provide crawling in batches of 10 iterations at a time (with 12 groups in one iteration) before the script would detect a CTRL+C. This means that if a user presses CTRL+C while iteration 1 is going on, the script would complete all remaining and safely exit, not killing any crawls mid way. But this may mean the user would have to wait for longer. To reduce wait times we could decrease the number for 10 to something smaller. Note : reducing to something smaller incurs an overhead of start sparkler everytime (reserving JVM resources and spark, etc) — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#5 (comment)>, or mute the thread<https://github.com/notifications/unsubscribe-auth/AAHbFIQNNE6cXmQSGkSodthmtY8oevsyks5sEWvkgaJpZM4N7hPL>.