Huge Memory & CPU Usage about litedb HOT 2 CLOSED

Hi @KeKl, thanks for your comment.

Performance and memory use drops in LiteDB when you are working with huge mass of data. This reason is because LiteDB implement a full transaction and journal backup save. Transactions are memory only (thats why use too many memory) and journal write in disk twice.

To works fast with huge data in LiteDB, try to use:

using(var db = new LiteDatabase(@"filename=.\LiteDB.db; journal=false"))
{
    var col = db.GetCollection<Node>("nodes");
    col.InsertBulk(nodes);
}

• nodes var must returns and IEnumerable<Node> and will be better if uses yield return

This code must run fast, but never as Newtonsoft or Text File. LiteDB implements indexes (at least _id index), data in pages, and has a much more complex data structure.

I have some plans to remove some features (like transactions and journals) in prior be simple, less memory usage and faster.

from litedb.

Hi @mbdavid,

thank you for your answer.

I tested also your implementation. It´s faster.

Thank you!

Regards,
Kevin

from litedb.