billymg: that time only got one. also noting that our loggers are out of order with those bot echos
billymg: http://logs.nosuchlabs.com/log/asciilifeform/2022-05-03#1099696 http://logs.nosuchlabs.com/log/asciilifeform/2022-05-03#1099697
billymg: that time it worked
billymg: http://logs.bitdash.io/asciilifeform/2022-05-04#1099691 << hrm, the second ref didn't get a backlink annotation, it should though (looking at the code it's not immediately apparent to me why it didn't). test
billymg: appreciate it, verisimilitude
billymg: http://logs.nosuchlabs.com/log/asciilifeform/2022-04-30#1099421 << this one should annotate backlinks from non-self loggers but not echo them
billymg: !. version
billymg: phf: i actually never noticed the 'title' attributes on the backlinks in btcbase.org until cribbing from it while working on this version, thought it was a nice touch
billymg: phf: ty
billymg: anyway it brought it down from 600ms to around 4-6ms like the other query
billymg: err, not in the subtable, in the main select
billymg: so in that subtable creation it's looking up by 'ser', but there was no index on that
billymg: the query (with sample values) looks like: SELECT * FROM loglines WHERE ser IN (SELECT unnest(backlinks) FROM loglines WHERE chan='asciilifeform' AND t BETWEEN '2022-04-26' AND '2022-04-27');
billymg: it needed an index on the serial id
billymg: fixed it
billymg: aha
billymg: well, unfortunately not solved with the index
billymg: so that's the culprit, i will see if adding an index on the backlinks field helps (doesn't currently have one)
billymg: signpost: ok, some quick testing with the queries: the query to get the lines for one day takes about 6ms on both my laptop and the rk. the query to get the backlinks for one day takes 133ms on my laptop and 600ms on the rk
billymg: yeah the crawler www is on ec2 now, the rk couldn't handle all the work done for the homepage
billymg: ah thanks
billymg: the backlink feature does add one extra sql query to each load
billymg: asciilifeform: do you have anything available atm?
billymg: i really think i just need to get it on a faster box regardless
billymg: whaack: do logs.bitdash.io links also seem slower than before?
billymg: takes extra long*
billymg: i might have to disable that for now until i move it to faster hardware
billymg: whaack: it now takes extra slow when clicking a dulap link because it's doing two redirects
billymg: signpost: that's a nice visualization, i've been meaning to start experimenting with d3 (would rather use that than tableau)
billymg: ty whaack, wb
billymg: that's optional, there are fallbacks specified
billymg: asciilifeform: i'm gonna also do a light theme, perhaps after you see that variation you'll want to use it on your www
billymg: to enable the link tunneling feature you built for the era1 and era2 loggers
billymg: i also added a knob to the config that looks like "other_loggers = logs.nosuchlabs.com/log" and takes a comma-delimited list of other active logotron-based loggers
billymg: i wanted to include ossasepia links too, but out of sync
billymg: takes 190 seconds to run on two of my laptops (not even that high powered), but 1205 seconds on my rk
billymg: asciilifeform: here's the backfill script: http://paste.deedbot.org/?id=vC4E
billymg: the first backlink is from a dulap ref
billymg: asciilifeform: ok backfill finished, but didn't get the last few lines, but see e.g. http://logs.bitdash.io/trilema/2016-12-21#1587491
billymg: http://logs.bitdash.io/asciilifeform/2022-04-27#1099340 << ty, right now it's a constant set at 15 min threshold but should probably be a config knob
billymg: in the bot
billymg: but yeah, i need to fix that
billymg: lol backfill will catch it by the time it gets there
billymg: aha, yeah, forgot that piece with the bot
billymg: oh, no, the backfill script is currently churning through the historical logs
billymg: asciilifeform: which, the backlinks?
billymg: http://logs.bitdash.io/asciilifeform/2022-04-27#1099323 << not bad, seems like my db issues from before finally went away
billymg: !. version
billymg: !. uptime
billymg: !. version
billymg: !. uptime
billymg: yep, the same one
billymg: ah, right, looks like no 192.187.114.50
billymg: asciilifeform: do you happen to know if that's the box BingoBoingo is using as the 'piz lifeboat'? if so my blog's still hosted on that
billymg: l
billymg: crtdaydreams: also, i don't know what state your kernel config is in but your specs sound pretty conventional, i wouldn't be surprised if you can boot with a completely unmodified kernel config (save at a minimum enabling nvme support if you're trying to boot off one of those). i mention this in the guide as wel
billymg: i was on the "nouveau" open source drivers for a while but performance was dog shit and my card isn't powerful enough to make up for that (besides the boxes aren't of the mission critical variety so i didn't mind adding the closed source blobs)
billymg: crtdaydreams: hrmm, i also have nvidia cards in two of my desktop builds, i found this page useful/straightforward for setting the kernel config correctly
billymg: you can literally show them the open door to their cell and they won't walk out, they prefer the cell
billymg: got a friend like that too, i keep telling him "take it off coinbase", he's smart, he understands the implications, and yet he *chooses* to keep it on coinbase, because that's how you "behave"
billymg: later signpost
billymg: i've got these family members, one of whom i set up with a paper wallet back in '15 or so. now the other family member is telling the former "you should put that on coinbase, where it's regulated"
billymg: whatever bitcoin will carve out, if it can carve anything out, will be niche
billymg: the last two years killed any hope of "great awakening" for me
billymg: http://logs.bitdash.io/asciilifeform/2022-04-26#1099045 << the only thing with bitcoin that the reich works harder to suppress than the exchange rate is the emergence of true p2p markets
billymg: http://logs.bitdash.io/asciilifeform/2022-04-26#1099019 << black market to me just means normal trade between free agents without having to cc nancy pelosi on all transactions > $600. iow 'black market' includes food and clothes
billymg: thehorrors: the importance of the prb shithub account is overblown. they can do what they want over there and hodlers are free to continue running older versions of bitcoin, such as trb for example
billymg: ^
billymg: thehorrors: the monero creator himself used to hang out here
billymg: thehorrors: no one cares how many zeros to the right of the decimal point there are, if it eventually comes to that because too many people accidentally all their coins
billymg: thehorrors: you can search the logs re: tradeoffs of a public ledger but iirc discussions usually conclude with something like "not ideal, but only way to prove no one is inflating the supply"
billymg: and yet some people and businesses accept it as payment
billymg: (or paying with btc, similarly)
billymg: thehorrors: why not 'getting paid' in btc?
billymg: thehorrors: re: cryptography, you've probably seen asciilifeform's ffa then. if not, sounds like it might be of interest to you
billymg: most folks here only interested in bitcoin, and this variety specifically
billymg: http://logs.bitdash.io/asciilifeform/2022-04-26#1098835 << what kind of engineer?
billymg: if that's what you meant by whether it's "safe"
billymg: http://logs.bitdash.io/asciilifeform/2022-04-26#1098864 << i thought like this when i first joined the chan and put up my blog. it's all in your head, no one's going to "cancel" you
billymg: verisimilitude, thehorrors: can't speak for everyone but i agree with signpost on that matter
billymg: last election made it obvious votes no longer matter, even superficially, so naturally people will lose interest in that game and need a new struggle to sink energy into
billymg: i think it's part of a transition to a new red vs. blue, media coverage of biden vs. whoever will go down while coverage of woke ceos vs. based ceos goes up
billymg: not saying it's centrally coordinated, i like asciilifeform's way of putting it, they're playing jazz
billymg: or perhaps the old stuff just wasn't selling anymore
billymg: signpost: my thinking is it helps transition people to the new reality. the corporate leaders have been in control for a while but now plebs get to fight and cheer for their favorite team like in red vs. blue
billymg: etc. etc.
billymg: "musk slam's bezos saying he will appeal the decision"
billymg: and just like broken campaign promises, headlines will read "bezos and tim cook block elon's latest move to allow saying faggot on the platform"
billymg: this twitter thing being a good example
billymg: has anyone else also noticed the shift in media political coverage away from covering so-called "actual" politicians to covering corporate leaders as though they were politicians?
billymg: speaking of forbidden words, looking forward to people testing the limits of elon musk presents twitter and realizing nothing has really changed
billymg: signpost: or in /g/ terms: "works on my machine"
billymg: i got all the pieces of backlinks fully working yesterday (backfill script, bot component, reader component), hopefully have it live later this week
billymg: http://logs.bitdash.io/asciilifeform/2022-04-25#1098755 << shouldn't have had to mess with this anyway, it's off / commented by default (at least that's what i'm seeing, and i didn't have to edit this conf file at all on my recent build without linux-firmware)
billymg: on my recent htpc build i used genkernel for building the initramfs but never had to install linux-firmware. the only reason i needed it on the thinkpad x1 was for the intel wifi chip
billymg: crtdaydreams: i also don't believe that linux-firmware is a required dep of genkernel
billymg: also what are your specs? cpu/mobo?
billymg: what do you mean 'hanging at usb'? maybe i or someone else here can help
billymg: morning crtdaydreams, thank you for the feedback
billymg: i have it fixed on my local copy that i'm working on now
billymg: adlai|textonly: that is correct, it's a bug
billymg: actually, possibly the ossasepia links are fine (i thought i hit one that wasn't but now a few more spot checks are resolving fine). a few more random checks with ericbenevides are only resulting in misses
billymg: same with logs.ericbenevides links
billymg: asciilifeform: in looking closely at these now, straightforward regex conversion might not work, the indexes are off
billymg: asciilifeform: the table + indices is almost 900mb (897 according to \l+ in pg)
billymg: though asciilifeform's gzipped dump totals ~80mb, so 300mb seems right
billymg: could be compressed
billymg: ah, yeah, not sure how pg is calculating that
billymg: trilema, asciilifeform, pest, ossasepia, etc. etc.
billymg: phf: that's for all the chans in my db
billymg: so could even store in memory on the RK
billymg: asciilifeform: using \d+ in postgres shows the complete loglines table at 300MB
billymg: phf: it was helpful for understanding another way of doing it, and what the tradeoff is with the db model
billymg: makes it more portable
billymg: asciilifeform: alternative is a chan/idx compound key
billymg: that's the first part that i'm working on now anyway, the "backfill" script
billymg: 'ser' will only work if generated by the operator, won't be "portable" (because different operators can have different list of chans)
billymg: asciilifeform: ah, i see what you're saying
billymg: in the context i thought maybe some data format
billymg: ah, yeah, i joined post kako
billymg: kako?
billymg: and were the annotations included?
billymg: phf: how did you store the logs on disk?
billymg tested and SELECT COUNT(DISTINCT(ser)) FROM loglines; == SELECT COUNT(ser) FROM loglines;
billymg: asciilifeform: re: 'ser', why does it matter if not the primary key as long as it's globally unique?
billymg: phf: could you expand on how you handled backlinks?
billymg: oh lol
billymg: or on disk
billymg: phf: did you store backlink ids in the db anywhere?
billymg: yeah, i'll use 'ser', that works
billymg: asciilifeform: ah, ok that makes sense then
billymg: to support cross-channel backlinks would also need to specify the channel
billymg: that would only work for backlinks within a channel though, unless i'm missing something
billymg: i'm working on the backlinks feature for the logotron, noticed in the schema you already have a backlinks field of type integer[]
billymg: morning asciilifeform
billymg: http://logs.bitdash.io/asciilifeform/2022-04-14#1095624 << i'll add this if asciilifeform doesn't beat me to it, i have a list of a few other UX tweaks i've been meaning to make
billymg: http://logs.bitdash.io/asciilifeform/2022-04-12#1095303 << i actually just spent a couple days last week putting together a gentoo file server / htpc out of some spare parts. was a fun project
billymg: new site is up and all crawler related stuff has been temporarily moved to ec2. the logger is still on the rk in asciilifeform's rack, only now with more resources to itself
billymg: !c trb-status
billymg: asciilifeform: added theme switch knob to footer, it sets a cookie
billymg: metrics*
billymg: if anyone has suggestions for other network metric's they'd like to see charted lemme know, i'd like to add more
billymg: currently, yes, displays the sad state of affairs
billymg: it will be once trb nodes go up by two orders of magnitude
billymg: both just flat lines along the bottom
billymg: there are three, but due to the scale trb's 14 and trb-compat's ~40 nodes don't represent much against prb's 4k
billymg: asciilifeform: i'll add a toggle for the old color scheme, currently only set via OS knob
billymg: mostly just a facelift, but is also responsive now, and displays the time series data. color scheme is auto based on your OS preference (e.g. "dark mode")
billymg: btw, still a WIP but i've got an updated version of the crawler www running here now: http://dev.bitdash.io/
billymg: did you ever restart with a series of -addnode flags?
billymg: whaack: for the longest time no other nodes were returning it as a peer (which is currently the only way the crawler can discover a new node). i noticed yesterday that it was finally found and queried to see who had reported it
billymg: whaack: got picked up automatically
billymg: !c net-summary
billymg: results from db of nodes returning it as one of their peers: http://paste.deedbot.org/?id=sMnv (previously this query returned 0)
billymg: though in a later patch i think i removed all the icons anyway, so currently the only images are the theme screenshots (iirc)
billymg: for the purpose of icons, specifically, can use actual svg. don't need to encode png/jpg binaries
billymg: that was done in genesis, and botched originally
billymg: the general sentiment seems to be, "ugh, i hate using this pos, but no alternative atm
billymg: tbh i sort of lost interest in it though. in its current state, "works for me", and polishing the mp-wp turd in general was miserable and thankless work. i can handle miserable, and don't mind thankless, but the two together killed my motivation
billymg: http://logs.bitdash.io/asciilifeform/2022-04-01#1091980 << that's fair criticism. my plan, perhaps never articulated, was to re-add the few useful pieces that were removed
billymg bbl, errands
billymg: phf: a lot was lopped off in that last patch, details here
billymg: phf: there are a few more after that one: http://billymg.com/mp-wp-vtree/
billymg: with the complete set of changes that is
billymg: yeah, i can test it, see if it works on both
billymg: a hard requirement
billymg: i never really looked into this because i assumed php5.6 was one of those "from my cold dead hands" things
billymg: ah, damn
billymg: phf: do you know off the top of your head if the changes required for php7 compatibility break 5.6 compatibility?
billymg: phf: if you're willing to diff your version against the original tgz and share the patch i could manually create a vpatch for mp-wp that adds the php 7 compatibility
billymg: knowing that austin would keep 'em
billymg: signpost: when i was in austin an uber driver told me houston and dallas would load theirs onto busses and send them to austin
billymg: wainotinspec!? transphobic!
billymg: in 2022 asciilifeform can indeed be rhinoceros if he likes
billymg: asciilifeform: ty, appreciate it
billymg: asciilifeform: any progress on the extra dulap?
billymg: might just try ordering another one then
billymg: hrm
billymg assumed the low price was because "burned out in google datacenter" prior
billymg: thimbronion: interesting, similar price too?
billymg: thimbronion: iirc you got yours from ebay too?
billymg: $125 for the board, chassis, and two opterons
billymg: asciilifeform: it was this guy: https://www.ebay.com/itm/333442066992
billymg: no luck, with the second ps either
billymg: oh well
billymg: will try the other ps then, came with two
billymg: ah
billymg: or is that not possible?
billymg: to the PS
billymg: right but was thinking potentially the UPS isn't delivering enough
billymg: i can try plugging directly into the wall instead of the UPS
billymg: interesting
billymg: bios even recognizes the usb stick plugged in (shows correct vendor, etc)
billymg: asciilifeform: from visual inspection it seems like everything is fine with the internals
billymg: in any case, yes, damaged during shipment
billymg: this was carried in a suitcase, not shipped
billymg: bend*
billymg: asciilifeform: heavy objects on top will also bent
billymg: the board/chassis is the least expensive part of the build, could order another one
billymg: asciilifeform: dunno if dropped, but bent somehow
billymg: i do not
billymg hasn't tried for a couple of hours but did notice "low" cpu temps on that screen after a few minutes
billymg: i.e. nothing is screaming "error"
billymg: even though happy bios settings screen, happy beep?
billymg: asciilifeform: the thing is, i've tried booting with the raid card pulled, same thing
billymg: asciilifeform: never gets to raid's post rom, no
billymg: when it gets stuck there's nothing on the screen, display just says "no signal from input"
billymg: get's stuck after that step
billymg: asciilifeform: first displays post screen, with "press DEL to enter setup". i can go into bios settings just fine.
billymg: asciilifeform: this card: https://www.amazon.com/gp/product/B004ZQS82W/
billymg: plugged in*
billymg: also tried removed all but two sticks of ram, rotating those, tried without the raid card plugge din
billymg: so i finally got the raid card and correct 2.5 to 3.5" sled adapters for my server but i can't get the thing to boot a gentoo install disk. worst part is nothing seems obviously wrong (gives single "all good" post beep, bios appears to work fine and doesn't show any errors, ram check on post passes)
billymg: i'm not so pessimistic, though maybe the world is 100% rule-by-orc
billymg: is it wrong to want to flee the bad guys?
billymg: ah
billymg: what's "making legs"?
billymg: then the next country offers slightly better deal, and so on
billymg: signpost: it doesn't have to be fair for all definitions of fair, just has to be "more fair" than 20% capital gains + suppressed exchange rate
billymg: asciilifeform: could be, but i could also see some governments realizing that, at least for btc, carrot it more effective than stick
billymg: asciilifeform: so you were more saying "it's a trap!" if any country offers you something in exchange for btc
billymg: asciilifeform: ah i see
billymg: if you find yourself on the train car just blow your brains out to spite them
billymg: they can't take the keys
billymg: difference is they can lift the watch off your corpse
billymg: keep the rate suppressed so that you have to voluntarily spend your stack
billymg: asciilifeform: i.e. exchange rate games?
billymg: they die with you
billymg: you die with them
billymg: they don't get your coins is what i'm saying
billymg: which they would otherwise take to the grave
billymg: btc*
billymg: why not good for the fact that they have bt
billymg: before it grows another zero
billymg: countries should jump on opportunity to court reich refugees now
billymg: in fact, if exchange rate is low, better deal for the government, they get more in btc terms
billymg: exchange rate seems orthogonal to a country making it freely legal / selling citizenship for it
billymg: but things are moving fast lately, could be sooner than we think
billymg: yes, this is a 'hodl until victory' strategy
billymg: just wishful thinking at this point, but if people prove really good at keeping their cold storage cold then countries might start to return to the carrot as a way of getting some