-
JAA
-
h2ibotJAA: Skipped 1309 invalid URLs: transfer.archivete.am/13md4v/lnk.bio-filtered-outlinks.bad-urls.txt (for 'transfer.archivete.am/aGn6u/lnk.bio-filtered-outlinks')
-
h2ibotJAA: Deduplicating and queuing 142168 items. (for 'transfer.archivete.am/aGn6u/lnk.bio-filtered-outlinks')
-
h2ibotJAA: Deduplicated and queued 142168 items. (for 'transfer.archivete.am/aGn6u/lnk.bio-filtered-outlinks')
-
JAAOutlinks from AB crawl of lnk.bio a couple months ago (job cn0hyzgpvabbskvg8f08rg1l6), filtered somewhat aggressively to remove the things we can't process here.
-
JAAgrep -Fv -e //kauth.kakao.com/oauth/ -e //access.line.me/oauth2/ -e //nid.naver.com/oauth2.0/ -e //discord.com/oauth2/ -e //www.tiktok.com/v2/auth/authorize/ -e //accounts.google.com/o/oauth2/ -e //login.microsoftonline.com/common/oauth2/ -e //appleid.apple.com/auth/authorize urls | grep -Fv -e //s3.us-west-2.amazonaws.com/ -e //cdn2.lnk.bi/ -e //cdn.lnk.bi/ | grep -Pv
-
JAA'^https?://([^/]*\.)?(facebook\.com|instagram\.com|cdninstagram\.com|twitter\.com|tiktok\.com|tiktokcdn\.com|youtube\.com|linkedin\.com|wa\.me)/'
-
JAAAnd prior to that: sqlite3 wpull.db 'SELECT url FROM queued_urls JOIN url_strings ON url_string_id = url_strings.id WHERE status = "skipped" AND url NOT LIKE "%//lnk.bio/%" AND inline_level is NULL' >urls
-
fireonlive
-
h2ibotfireonlive: Invalid privileges, need one of ('@', '+').
-
fireonlive.voice
-
fireonlive
-
h2ibotfireonlive: Deduplicating and queuing 24886 items. (for 'transfer.archivete.am/K24Zr/lbry-discord-urls.txt')
-
h2ibotfireonlive: Deduplicated and queued 24886 items. (for 'transfer.archivete.am/K24Zr/lbry-discord-urls.txt')
-
fireonliveincluded link previews too; in case the cached previews linked to content that has since died
-
Flashfire42.voice