Freezes up on large log files, eats all memory, crashes Explorer, etc.


Freezes up on large log files, eats all memory, crashes Explorer, etc....
Author
Message
Johnny Appleseed
Johnny Appleseed
Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)Gaining Respect (152 reputation)
Group: Forum Members
Posts: 15, Visits: 32
Accidentally tried to open a postgres.log file that was 22GB (didn't realize it was that huge) and LVP took ages to parse. After a few hours I just went to bed and it was only about 1/8 done parsing.

Woke up this morning and it had entirely crashed explorer. It also killed my entire Docker server and all of it's services because it ran out of memory as well. I looked at it's resource usage and it looked like this:



Granted no one should really be trying to view a 22GB log file, but it also seems like some bad handling by LVP as well. Perhaps some initial warning about it's size being too big when trying to open it? And/or only loading it in chunks that still load fast and don't eat up infinite memory, only showing as much as can fit in the viewing pane plus a bit in the buffers above and below for short scrolling and making it appear smooth, or some other similar wizardry? And/or only allowing a max mem usage of x percent of system mem and then it stops trying to load/parse, the log. And so on?
Edited 6 Months Ago by Johnny Appleseed
GO

Merge Selected

Merge into selected topic...



Merge into merge target...



Merge into a specific topic ID...





Similar Topics

Login

Explore
Messages
Mentions
Search