lewismoten / cheerfuldrill Goto Github PK

Export data to a CSV file.

Add ability to add/update/remove extractors via the UI.

Provide a way to extract a list of data from the same file. ie - multiple books (price, title) from one file.

Add ability to load extractors from a file, and save them as well via the user interface.

Create UI to setup and execute the data extraction.

Create an app that can run rules to refine the data that was extracted from text files pages. Rules such as - remove "Mr." "Dr." and other prefixes from names.

Provide a way to extract data from multiple files on the local file system.

Some records may be located in multiple places. Add support for a way to keep track of this so that the same data is not parsed multiple times.

Preferably use regular expressions to pull data out of an HTML file.

Given at least one extractor exists
When starting to exctract
Then exception is thrown.

System.InvalidOperationException was unhandled by user code
HResult=-2146233079
Message=Cross-thread operation not valid: Control 'listView1' accessed from a thread other than the thread it was created on.
Source=System.Windows.Forms
StackTrace:
at System.Windows.Forms.Control.get_Handle()
at System.Windows.Forms.ListView.ListViewNativeItemCollection.DisplayIndexToID(Int32 displayIndex)
at System.Windows.Forms.ListView.ListViewNativeItemCollection.get_Item(Int32 displayIndex)
at System.Windows.Forms.ListView.ListViewNativeItemCollection.CopyTo(Array dest, Int32 index)
at System.Windows.Forms.ListView.ListViewNativeItemCollection.GetEnumerator()
at System.Windows.Forms.ListView.ListViewItemCollection.GetEnumerator()
at System.Linq.Enumerable.d__b11.MoveNext() at System.Linq.Enumerable.WhereSelectEnumerableIterator2.MoveNext()
at System.Linq.Enumerable.d__b11.MoveNext() at System.Linq.Enumerable.WhereSelectEnumerableIterator2.MoveNext()
at System.Linq.Enumerable.d__b11.MoveNext() at System.Collections.Generic.List1.InsertRange(Int32 index, IEnumerable1 collection) at System.Collections.Generic.List1.AddRange(IEnumerable1 collection) at LewisMoten.Spiders.CheerfulDrill.UI.Form1.Shake(IProgress1 progress, IEnumerable`1 extractors) in c:\Users\Lewis Moten\Documents\GitHub\CheerfulDrill\LewisMoten.Spiders.CheerfulDrill.UI\Form1.cs:line 88
at LewisMoten.Spiders.CheerfulDrill.UI.Form1.<>c__DisplayClass1.b__0() in c:\Users\Lewis Moten\Documents\GitHub\CheerfulDrill\LewisMoten.Spiders.CheerfulDrill.UI\Form1.cs:line 76
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.Execute()
InnerException:

Setup MVP to permit separation of logic from presentation, and allow for more testing.

Allow extractor control to resize when main form is resized. (prevent empty white space)

Create a console app to run data parsing via command line.