jfw: thanks whaack, I had some fun with that.
jfw: what occurred to me for your present fleet memory issue: I would imagine sbcl has a way to run the garbage collector explicitly and capture the stats programatically (I expect there's only one of interest really, "how much heap is in use?" - not sure where that is exactly in the detailed output.) Make a loop interleaving that with whatever operation you want to test - joining a network perhaps -
jfw: or run it periodially in a thread, logging to a file. See how it evolves over time. This is a rough sort of approach; maybe sbcl has some fancier memory profiling. Or more study of your own + cl-irc code couldn't hurt.
jfw: really it seems to me there should be epsilon change in memory usage with respect to time for a given number of networks, since messages are logged externally.
jfw: also you could run a local ircd ("ratbox" came up as one of the supposedly solid options last I looked into this) to facilitate a large number of connections / other noisy tests.
diana_coman: http://logs.ossasepia.com/log/ossasepia/2020-02-28#1019734 - what's wrong with enjoying learning and/or puzzles? re hardware though, it's a sort of once-removed to learn about it via tools on top and it's unclear why would you go that route at all.
ossabot: Logged on 2020-02-28 16:52:44 whaack: diana_coman: tbh I have a concern that the reason I want to learn the cmd line tools is in part because I enjoy solving little puzzles. Otherwise I would say I want to learn them because I see them as a means to increase my productivity and I guess also (this could be added to my list of whys) as a way to learn about topics such as networking and how various parts of a computer work (tools can
diana_coman: http://logs.ossasepia.com/log/ossasepia/2020-02-28#1019730 - nice, well done jfw ! and indeed, not having a republican block explorer sucks.
ossabot: Logged on 2020-02-28 16:45:27 jfw: In other news, a gbw transaction escapes into the wild: https://www.blockchain.com/btc/tx/7386679d841bdca0b7c412d09d936627e7310597542be8f7d75cb39811d799b1
whaack: jfw: http://logs.ossasepia.com/log/ossasepia/2020-02-29#1019741 Right. I don't think that the memory used is growing directly with the number of messages logged, since the bot that is still running has logged over 3x as many messages as the one that crashed.
ossabot: Logged on 2020-02-29 02:27:57 jfw: really it seems to me there should be epsilon change in memory usage with respect to time for a given number of networks, since messages are logged externally.
whaack: When I use the (room) function on my bot that is still running I can see that the memory usage fluctuates. There may be some non negligible memory being used when a large number of incoming messages occur all at once. If I am receiving messages faster than I can write them to the postgresdb for a long enough period of time, that would cause my program to run out of memory.
whaack: in interesting weird found in my irclogs http://bitcoinshell.mooo.com/
whaack: the owner of the site offers a VM with 128MB of disk space to anyone, but to create an account on the vm you need to beat his bot in a telnet game of pong.
whaack tried but gave up since it takes a bit of time to secure the victory.
whaack: diana_coman: there's nothing wrong with enjoying learning or solving puzzles. but if that's the only/primary reason to learn something then maybe one's learning what they want to learn rather than what they need to learn.
jfw: thanks diana_coman!
jfw: whaack: looks like what I had in mind can be done by the entirely undocumented (sb-kernel:dynamic-usage), following a (gc :full t).
jfw: Certainly the database will need to be able to keep up, there may be some postgres tuning to do if that's really the problem. But does your code really queue up messages from the network before processing them? Why?
whaack: jfw: Any message queueing that may be happening is unintentional. I believe that the code waits for the db write to finish before calling "select2" to read the next line. My guess is that incoming messages that have not been "read"'d take up some space in the sbcl process, and if as you say the database can't keep up, those incoming messages waiting to be read and then written to the db pile up
whaack: and cause an OOM error
jfw: whaack: assuming these select2/read are ~equivalent to the corresponding system calls, then no; there's some limited buffering done by the kernel; when that fills, tcp flow control will stop the server from transmitting until more space is made.
whaack: jfw: ah thank you, that is very good to know.
jfw: yw.
ossabot: (agriculturalsupremacy) 2020-02-29 BingoBoingo: thimbronion: Which story would you rather write, the chinese spy scoop you've been weighing all week or the US surrendering to the Taliban?
ossabot: (agriculturalsupremacy) 2020-02-28 BingoBoingo: jfw: Ty, I'll leave this open for 5 hours to see if any takers claim it while I do Spanish class and work on refining the plan.
diana_coman: did that older possible story fade entirely given the great handling ?
BingoBoingo: It didn't, it's still a hole in coverage, less fresh and still open.
diana_coman: BingoBoingo: yes but specifically what are you going to do? and moreover, you've got now to see that there is this sort of potential situation - and it's a *good* one ie kuddos to jfw for the lead there! - so don't ignore it/sleep on it because it's not *yet* biting you hard enough or something; plan ahead so it does NOT end up biting you harder.
BingoBoingo: diana_coman: Alright, I'll cover it today. I'd been trying not to write myself for Qntra before 19:00 hrs UTC to keep it from consuming the bulk of the day, but it seems pretty clear that when these leads come in I'm going to have to carve out some time to hammer a piece, then move whatever got displace into whatever time I'd reserved to searching and hammering out an unknown story later.
diana_coman: BingoBoingo: yes, you are the last resort writer there currently, no way around it; the solution is to make sure the last resort gets activated less often, but not to just not step up to it when/if needed.
whaack: I agree, jfw's article is gold, it's a new development in the ongoing story of "people" storing "their" bitcoin in anyone can spend addresses. qntra should milk the segwit line until the miners finally take the coins that are laying on the table for them. If qntra ran a piece that explained the manner in which coins are taken from someone storing their coins in segwit the article would be like
whaack: http://qntra.net/2015/01/the-hard-fork-missile-crisis/ and hopefully would have similar results
BingoBoingo: Stepping back into the bigger picture I'm going to have to define the problem of allocating my time on the day-to-day by priority
diana_coman: BingoBoingo: certainly; pretty much everyone's problem apparently but still no other way around this - either you really allocate your time purposefully on what IS the highest priority for whatever goals you have (and this does imply you have clear goals and clear plans and all that, yes) or you'll just flail about and find deadlines impossible to stick too and wonder why everything is late and not advancing and so on and so forth.
diana_coman: stick to* ; apparently I have a surplus of oo lately
whaack: lool
BingoBoingo collecting this fodder for the weekly review.
diana_coman: whaack: what's the next episode in the My Friendly Mechanic series?
whaack: diana_coman: The mechanic texted me saying the car is good. The total dammages were about 10-16 hours of my time and $600 for a new alternator and a new battery. When I picked up the "all good" car, the car was vibrating quite strongly while in neutral. After driving around the vibrating stopped and hasn't returned. The friendly mechanic said that since the car lost power completely the computer
whaack: needed to "recalibrate parameters". The car has an error code that indicates the sensor that regulates oxygen intake to the motor is not working.
whaack: I asked him how long it would take to fix the sensor, and he said he cannot get it done before next week (when I have some friends visiting and we're going to make a trip to Arenal/La Fortuna - about a 3 hour drive) He said that the oxygen intake sensor should be fixed but I am probably good to go and can address the problem when I get back.
diana_coman: ahaha, it would totally make a great cartoon for sure.
diana_coman: whaack: I hope you did/do get a camera for the trip at least, right?
whaack: diana_coman: yup, thanks to billymg I have a replacement camera
BingoBoingo: whaack: For that recalibration usually there's a procedure you can carry out from the driver's seat while the car's idling, but what exactly it is depends on the make and model. It may or may not be faster than simply driving and letting the engine control unit figure it out.
diana_coman: whaack: did you get the car's manual when you bought it?
diana_coman: such a thing should be in there or I'd expect it to be.
whaack: diana_coman: No, although I found it online. There was none in the glove compartment but iirc from reading some of the online manual I recall there is another storage compartment that has the tools for fixing a flat tire, where the paper manual may also be.
diana_coman: whaack: you know, I *did* want to ask you if you at least know what to do if you get a flat tire at some point, lol.
whaack: diana_coman: Do you still want to ask?
whaack: lol
whaack: I asked for taxi amigo to teach me, but we were unable to find the jack. It may be in the compartment mentioned in the manual, I'll check later today/tomorrow and make some time to learn how to change the tire before I go on the short road trip.
jfw: bwahahaha, what extras did it also just happen to not include, windshield wipers and a horn? Maybe they're in some compartment somewhere
whaack: argh the typeup of Butcher's translation of Aristotle's poetics was butchered in various places. Sentences just trail off randomly / chunks of text are missing
diana_coman: whaack: it's ok, those chunks of text might be in a compartment somewhere!
diana_coman at least laughed, headache and all.
whaack brb, gonna go check compartment
jfw: whaack: but yes, do practice changing a tire, with proper procedure for tightening the lugs, and check tire pressure regularly, including the spare.
jfw: If it's motivation, these things do impress the lady passengers in the event they get to be demonstrated.
jfw: that MIT classics site is in my memory for "the server crashed and we didn't have backups but it's ok, we rescued parts of most of the texts from google cache"
diana_coman: oh, as a lady passenger at times, I can certify to whaack that the demonstration of no-clue at such times is *also* extremely impressive in its own special way!
diana_coman: ahahah, that google cache must be the "compartment somewhere", now it all fits!
jfw: hehe.
feedbot: http://ossasepia.com/2020/02/29/a-basic-requirement-for-the-literate-introducing-of-new-tools/ << Ossa Sepia -- A Basic Requirement for the Literate Introducing of New Tools
whaack found the jack and tools in the other compartments, but no manual
diana_coman: jfw: btw, do you find the ack-of-having-debts as already paying them or what?
ossabot: Logged on 2020-02-27 15:38:09 jfw: http://logs.ossasepia.com/log/ossasepia/2020-02-27#1019476 - reminds me I've slipped on comment acknowledgement too.
diana_coman: whaack: lolz, discovering the hidden treasures in one's own car - after "owning" it supposedly for a few weeks already! Given this - are you sure you know what your own house contains?
whaack: jfw: aha I will learn quickly. and don't worry diana_coman, I have not gotten the opportunity to impress any ladies in that way - I had plans to give a cute cashier a ride to Santa Cruz but had to explain "mi carro esta con el mechanico"
jfw: diana_coman: argh, no I do not.
diana_coman: whaack: on the bright side, I ~never worry; on the funny side, that explanation is unlikely to be believed anyway (~everyone "has a car/house/amazing stuff that is just ...not available)
whaack: heh right, the yacht is also getting fixed atm
BingoBoingo rarely sees the yachts parked in "El Puertito de Buceo" move, ever. I'm starting to suspect a greater portion of them are effectively abandoned making the yacht club more of an impound lot than anything else.