serhii.net

qutebrowser clear data for a specific website

Can be done through dev tools! Clear all site data, just cookies, or anything else. [^qbprivgithub ]

Learning git

Will be using the old and awesome Git - Book and a small test local repo.

2.2 Git Basics

git status -s is short git status

Docker DEBIAN_FRONTEND=noninteractive

Setting it in Dockerfiles is discouraged (even by the official Docker FAQ ¹) because it’s mainly cosmetic & may create unwanted side effects.

For me, tzdata wanted input and waited for it:

[17:01:56][Step 1/3] debconf: falling back to frontend: Readline
[17:01:56][Step 1/3] Configuring tzdata
[17:01:56][Step 1/3] ------------------
[17:01:56][Step 1/3] 
[17:01:56][Step 1/3] Please select the geographic area in which you live. Subsequent configuration
[17:01:56][Step 1/3] questions will narrow this down by presenting a list of cities, representing
[17:01:56][Step 1/3] the time zones in which they are located.
[17:01:56][Step 1/3] 
[17:01:56][Step 1/3]   1. Africa      4. Australia  7. Atlantic  10. Pacific  13. Etc
[17:01:56][Step 1/3]   2. America     5. Arctic     8. Europe    11. SystemV
[17:01:56][Step 1/3]   3. Antarctica  6. Asia       9. Indian    12. US

Fixed this by adding this command specifically before the one requiring it:

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y

vaex - faster panda-like lib

TODO: Vaex: Pandas but 1000x faster - KDnuggets

Looks interesting. Why is it faster?

python subprocess run

subprocess.run() is the newer version of ..call(). Can run a string like this:

subprocess.run("echo  one two three", shell=True)

Qutebrowser throwaway email and password generatorr userscripts

Generate password, paste it into a textfield, and xclip the output:

#!/usr/bin/python3
import os
import string
import secrets
from subprocess import run
alphabet = string.ascii_letters + string.digits
password = ''.join(secrets.choice(alphabet) for i in range(8))

run(f"echo {password} | xclip -selection c", shell=True)
with open(os.environ['QUTE_FIFO'], 'w') as f:
    f.write(":insert-text {}".format(password))

Generate a throwaway email with email based on domain (so if I were to run it on google.com, it’d generate google@wildcard.mydomain.net:

#!/usr/bin/python3
import os
import tldextract
import argparse
import sys

argument_parser = argparse.ArgumentParser()
argument_parser.add_argument('--subdomain', '-s', default='t',
                             help='subdomain ("t" would do "@t.email_host.net")')
argument_parser.add_argument('--email_host', '-d', default='email_host.net',
                             help='main domain where you\'ll get the emails')
argument_parser.add_argument('--username', '-u', default=None,
                             help='the name used for email username (name@...)')
def main(args):
    my_domain = args.email_host
    subdomain = args.subdomain
    if args.username is not None:
        username = args.username
    else:
        url = os.environ['QUTE_URL']
        extract_result = tldextract.extract(url)
        username = extract_result.domain

    address = f"{username}@{subdomain}.{my_domain}"

    with open(os.environ['QUTE_FIFO'], 'w') as f:
        f.write(":insert-text {}".format(address))

if __name__ == '__main__':
    arguments = argument_parser.parse_args()
    sys.exit(main(arguments))

Use-case for both - quick easy registration in pointless places.

i3status VPN

My older approach was to use this:

run_watch VPN {
        pidfile = "/etc/openvpn/mv.pid"
}

And start openvpn in a way that it writes that specific pid file.

i3: i3status(1)’s documentation points at this:

path_exists VPN {
        # path exists when a VPN tunnel launched by nmcli/nm-applet is active
        path = "/proc/sys/net/ipv4/conf/tun0"
}

On my computer it was tap0 instead of tun0. But it works!

stow symlinks/targets

My ~/.dotfiles is a symlink to another place. stow follows it, and uses as target the parent directory of the directory the symlink points to, not ~/!

Explicitly setting a target directory is stow -t ~/ thing-to-stow (interestingly, stow -t ../ also uses the parent directory relative to the symlink target of the current one).

First I did the logical thing:

alias st='stow -t ~/'

Then, after reading the manual¹, created a ~/.stowrc:

--target=~/

Works now :)

Wallabag tagging rules

Wallabag supports tagging rules based on parameters, such as domain names or reading time. Nice!

qutebrowser wallabag bookmarklet

Added ww as binding to the bookmarklet.

Fiamma qutebrowser-specific vimrc

I finally moved Fiamma (my link wiki) to a the new server! Which reminded me about the bindings I wrote to automatically format the input for the links I add there.

For example, on Ron Burk: Commas Depend on Linebreaks - Fiamma, I edited the pre-filled things to look like this:

http://ronburk.blogspot.de/2009/09/commas-depend-on-linebreaks.html
Ron Burk: Commas Depend on Linebreaks
6
5

language, linguistics, internet, style, etiquette, mildly interesting

Language
Style

Then a vim snippet from hell transformed it to

{{B|
http://ronburk.blogspot.de/2009/09/commas-depend-on-linebreaks.html
|Ron Burk: Commas Depend on Linebreaks
|6
|5
}}
{{#set:
k=language, linguistics, internet, style, etiquette, mildly interesting
|+sep=, }}

[[Category: Language]]
[[Category: Style]]

Though they were in latin-1 encoding, the .vimrc got converted to utf8, and it all got lost.

Now I have a solution. ~/.config/qutebrowser/.qb-vimrc is:

source ~/.vimrc

" let @H = 'gg<80>ýc<80>ýbi<80>ýc<80>ýb{{B|^[^[^[j0i|^[^[^[ji|j<80>kb^[^[^[ji|^[^[^[o}};q' " For the 5 lines
" let @L = 'ji{{$<80>kb%<80>kb#set:\^Mk=<80>kD^[o|+sep=,}}^[' " For the tags
" let @C = 'i[[C;tj<80>kb<80>kb<80>kbategory: ^[^[^[A]];q' " For each individual category
" let @F = 'jjVG:norm! @C\^M' "Apply that to all lines till the end
" let @d = '@H@L@F'
" let @q = '^[A^[bbbbbbi|<80>ü^B<80>kb^[:%s/=/{{=}}/ge^M'

" Summed up:
let @C = 'i[[C;tj<80>kb<80>kb<80>kbategory: ^[^[^[A]];q' " For each individual category
"let @H = '^[A^[bbbbbbi|<80>ü^B<80>kb^[:%s/=/{{=}}/ge^Mgg<80>ýc<80>ýbi<80>ýc<80>ýb{{B|^[^[^[j0i|^[^[^[ji|j<80>kb^[^[^[ji|^[^[^[o}};qji{{$<80>kb%<80>kb#set:^Mk=<80>kD^[o|+sep=,}}^[jjVG:norm! @C^M:x^M'
let @H = '^[A^[bbbbbbi|<80>ü^B<80>kb^[:%s/=/{{=}}/ge^Mgg<80>ýc<80>ýbi<80>ýc<80>ýb{{B|^[^[^[j0i|^[^[^[ji|j<80>kb^[^[^[ji|^[^[^[o}};qji{{$<80>kb%<80>kb#set:^Mk=<80>kD^[o|+sep=,}}^[jjVG:norm! @C^M' " Without closing at the end
" let @d = '@H@L@F'

" Start in insert mode
startinsert

And in qutebrowser config, I set the editor to:

c.editor.command = ['kitty', 'vim', '-u', str(config.configdir / '.qb-vimrc'), '+{line}', '{file}']

This way, standard-vim uses the standard fancy utf8 config file, but qutebrowser uses a separate one that overwrites the needed lines with the latin-1 macros. vim +10 filename means open it and put the cursor on line 10, idea comes from Reddit[^ideared

(Macros are really hard to read. How can I use something like python next time for this?)

Also - them being defined in the ~/.vimrc seems to have broken the newer ones, had to comment them out. Does vim not like redefined macros?

DTB copy link as markdown

Updated my yank-for-markdown yank.py userscript to remove the anchor text ("…#!~:text=Text on the page to scroll to"), so I can paste it without it messing up the markdown formatting:

#!/usr/bin/python3
import os

title = os.environ['QUTE_TITLE']
title = title.replace("|", "\\|")

url = os.environ['QUTE_URL']
url = url.split("#:~:")[0]

command = "yank inline \"[{}]({})\"".format(title, url)

with open(os.environ['QUTE_FIFO'], 'w') as f:
    f.write(command)

Better Fiamma page creation with preloading

Rewrote the whole mechanism, now there’s one template that gets pre-filled by URI. First the qb userscript gets the data, writes them to a file; then opens this file in vim. When closed, it calls the new template passing the entire content of the file as first parameter.

Better because much simpler and less steps needed.

Random / quotes

[23:07:35] i mean, i have important work to do. dealing with an IRC network is not really something i want to be doing this decade outside of fucking around for fun with IRCX [23:07:51] i have code running on two planets ²

Qutebrowser crashing fix

I think I have this time - removing state got it to start without reinstalling/changing anything.

Using screen in places that don’t support screen

Figured out myself and kinda proud of this one. If server1 doesn’t have screen, you can ssh to it from inside screen of a server2 that does have screen! As long as the SSH connection is there it’ll work.

json dump of np.float32

When doing jsons.dumps(thing) where thing has np.float32s inside it, you get the error:

TypeError: Object of type 'float32' is not JSON serializable

This is fixed by:

• doing json.dumps(str(thing)) (though will return it as string, may or may not be what we want)
• Converting the np.float32s to standard python float before adding them to the object

Mosquito / MQTT / openHAB

• mosquito is an ubuntu implementation of the mqtt protocol, which is “subscribe to a broker for messages of type X and you’ll get them” - seems to be a standard like REST.
• OpenHAB is a self-hosted thing that nicely manages such endpoints

(from V.H’s presentation about “Как подключить вайфай к чайнику для чайников”)

NLTK preprocessing for German

German tutorial about preprocessing German with NLTK: Preprocessing

zsh add binding to edit in vim

Added a zsh binding that in vi command mode launches edit-command-line to edit the current line in vim proper:

bindkey -M vicmd v edit-command-line

Doesn’t conflict with zsh-vim-mode-plugin. It’s nice how they all build upon the existing zsh infrastructure and I can keep adding my own bindings using the same mechanisms.

BERT pytorch HF/HuggingFace NER Tensorboard

It puts the tensorboard files in ./runs of the directory I’m running the script from, not the output directory!

kitty hints

If there are a lot, the closest one to the cursor is marked , and can be selected by pressing <Enter>

qutebrowser browsing history

Started with a new profile, and realized how much I relied on it. Apparently suggestiosn based on browsing history is integral to my productivity

Vim sort lines

Highlight the wanted lines, then :sort!

This might be a place to look for similar vim commands: Vim documentation: change

Bash split textfile by percentage

Split: how to split into different percentages? - Unix & Linux Stack Exchange:

split -l $[ $(wc -l filename|cut -d" " -f1) * 70 / 100 ] filename 

This creates files called xaa and xab and works fine for my purposes.

POSIX standard for shells/utilities

Introduction - TIL that head doesn’t really follow them

zsh bracketed paste (don’t run command in terminal when pasting)

Stop terminal auto executing when pasting a command - Ask Ubuntu:

• If you copy a newline symbol at the end of whatever you are copying, it gets executed as expected
• bracketed paste (enabled by default on zsh) disables this behaviour

Had unset zle_bracketed_paste in zsh config, likely needed for athame that I don’t use. Removed it, works now.

To enable in bash,

echo "set enable-bracketed-paste" >> .inputrc

I should make an eventual list of dotfiles I use for all remote servers, this will go there 100%.

Docker COPY copies contents, not directory

Docker COPY copies contents, not directory \ Docker COPY copies contents, not directory \ Docker COPY copies contents, not directory \ Docker COPY copies contents, not directory \

kitty hint for IPs + python non-capturing (unnamed?) groups

Added these to kitty config! One for IPs, second IPs+ports:

map kitty_mod+n>i kitten hints --type regex --regex [0-9]+(?:\.[0-9]+){3} --program @
map kitty_mod+n>p kitten hints --type regex --regex [0-9]+(?:\.[0-9]+){3}:[0-9]+ --program @

Glad I can still read and understand regexes. The above highlight more than needed, but seems to be kitty’s problem.

In python, a group without ?: is a non-capturing group in python (= not returned in .groups()). In kitty (that uses python syntax), only what’s inside the first capturing group is copied; making it non-capturing makes it copy the entire regex. ¹

I added another kitty hint to copy CLI commands currently being typed:

# CLI Commands
map kitty_mod+n>c kitten hints --type regex --regex "\$(.+)\s*$" --program @

My regex is trivial, the capturing group gets the command without the leading $ and avoids all trailing whitespaces.

Docker run detached mode

The magic -dp 8000:8000 command I’ve been using is actually -d -p, with -p being what I want and -d turning on detached mode. Without it, I see the logs directly and can easily <Ctrl-c> it away.

Also, docker ps shows ports as part of the output.

Setting timezone

Let this be the final one, with all configs correct now:

timedatectl set-timezone Europe/XXX

Quotes

In the Buddhist interpretation of it, “BE WHERE YOU ARE”.

Remapping a Thinkpad T580 Fn key to Ctrl

The location of the Fn key on the laptop keyboard is absolutely idiotic and I hate it. Fn keys are usually handled by the hardware and ergo unusable. Now that I have to use the keyboard more, thought I have nothing to lose and tried xev and oh what a wonderful world it gets read as XF86WakeUp! Therefore it can be remapped to something more sensible. … like the Ctrl key it should be.

Easiest way for me was adding this to autostart:

xcape -e 'XF86WakeUp=Control_L' -d &

No side effects of the other xcape command xcape -e 'Control_L=Escape' -t 100, it seems to be considered a different Control_L key and clicking it fast doesn’t produce Escape.

Disable touchpad

xinput set-prop 13 340 1, where 13 comes from xinput -list

Dockefile RUN a lot of commands

It’s possible to do this instead of prefixing each command with RUN:

RUN apt-get update && \
    # install base packages
    apt-get install -y -qq apt-utils aptitude wget curl zip unzip sudo kmod git && \
    /usr/bin/python3 -m pip install --upgrade pip && \