BERT pytorch HF/HuggingFace NER Tensorboard

It puts the tensorboard files in ./runs of the directory I’m running the script from, not the output directory!

kitty hints

If there are a lot, the closest one to the cursor is marked , and can be selected by pressing <Enter>

qutebrowser browsing history

Started with a new profile, and realized how much I relied on it. Apparently suggestiosn based on browsing history is integral to my productivity

Vim sort lines

Highlight the wanted lines, then :sort!

This might be a place to look for similar vim commands: Vim documentation: change

Bash split textfile by percentage

Split: how to split into different percentages? - Unix & Linux Stack Exchange:

split -l $[ $(wc -l filename|cut -d" " -f1) * 70 / 100 ] filename 

This creates files called xaa and xab and works fine for my purposes.

POSIX standard for shells/utilities

Introduction - TIL that head doesn’t really follow them

zsh bracketed paste (don’t run command in terminal when pasting)

Stop terminal auto executing when pasting a command - Ask Ubuntu:

• If you copy a newline symbol at the end of whatever you are copying, it gets executed as expected
• bracketed paste (enabled by default on zsh) disables this behaviour

Had unset zle_bracketed_paste in zsh config, likely needed for athame that I don’t use. Removed it, works now.

To enable in bash,

echo "set enable-bracketed-paste" >> .inputrc

I should make an eventual list of dotfiles I use for all remote servers, this will go there 100%.

Docker COPY copies contents, not directory

Docker COPY copies contents, not directory \ Docker COPY copies contents, not directory \ Docker COPY copies contents, not directory \ Docker COPY copies contents, not directory \

kitty hint for IPs + python non-capturing (unnamed?) groups

Added these to kitty config! One for IPs, second IPs+ports:

map kitty_mod+n>i kitten hints --type regex --regex [0-9]+(?:\.[0-9]+){3} --program @
map kitty_mod+n>p kitten hints --type regex --regex [0-9]+(?:\.[0-9]+){3}:[0-9]+ --program @

Glad I can still read and understand regexes. The above highlight more than needed, but seems to be kitty’s problem.

In python, a group without ?: is a non-capturing group in python (= not returned in .groups()). In kitty (that uses python syntax), only what’s inside the first capturing group is copied; making it non-capturing makes it copy the entire regex. ¹

I added another kitty hint to copy CLI commands currently being typed:

# CLI Commands
map kitty_mod+n>c kitten hints --type regex --regex "\$(.+)\s*$" --program @

My regex is trivial, the capturing group gets the command without the leading $ and avoids all trailing whitespaces.

Docker run detached mode

The magic -dp 8000:8000 command I’ve been using is actually -d -p, with -p being what I want and -d turning on detached mode. Without it, I see the logs directly and can easily <Ctrl-c> it away.

Also, docker ps shows ports as part of the output.

Setting timezone

Let this be the final one, with all configs correct now:

timedatectl set-timezone Europe/XXX

Quotes

In the Buddhist interpretation of it, “BE WHERE YOU ARE”.

Remapping a Thinkpad T580 Fn key to Ctrl

The location of the Fn key on the laptop keyboard is absolutely idiotic and I hate it. Fn keys are usually handled by the hardware and ergo unusable. Now that I have to use the keyboard more, thought I have nothing to lose and tried xev and oh what a wonderful world it gets read as XF86WakeUp! Therefore it can be remapped to something more sensible. … like the Ctrl key it should be.

Easiest way for me was adding this to autostart:

xcape -e 'XF86WakeUp=Control_L' -d &

No side effects of the other xcape command xcape -e 'Control_L=Escape' -t 100, it seems to be considered a different Control_L key and clicking it fast doesn’t produce Escape.

Disable touchpad

xinput set-prop 13 340 1, where 13 comes from xinput -list

Dockefile RUN a lot of commands

It’s possible to do this instead of prefixing each command with RUN:

RUN apt-get update && \
    # install base packages
    apt-get install -y -qq apt-utils aptitude wget curl zip unzip sudo kmod git && \
    /usr/bin/python3 -m pip install --upgrade pip && \

kitty hints

Changed the hint I most often use to a better binding:

# Copy url
# map kitty_mod+n>c kitten hints --type path --program @
map kitty_mod+g kitten hints --type path --program @

Timewarrior

• w track 1728 tag1 automatically ends it `now``.
• w continue just continues the last thing running by starting something identical starting “now” and continuing till stopped.

kitty kittens

• Draw a GPU accelerated dock panel on your desktop — kitty 0.20.3 documentation
• icat - Display images in the terminal — kitty 0.20.3 documentation
  • alias icat="kitty +kitten icat"

kitty autocompletion

In zshrc:

autoload -Uz compinit
compinit
# Completion for kitty
kitty + complete setup zsh | source /dev/stdin

kitty scrollback pager

From Feature Request: Ability to select text with the keyboard (vim-like) · Issue #719 · kovidgoyal/kitty · GitHub:

scrollback_pager vim - -c 'w! /tmp/kitty_scrollback' -c 'term ++curwin cat /tmp/kitty_scrollback'

Vim 8.0 works. Nice colorful etc.

zsh vim mode timeout

Zsh Vi Mode:

Adding this allows to register the <Esc> key in 0.1 sec, not default 0.4.

export KEYTIMEOUT=1

A good documented vimrc

A Good Vimrc - TODO

I also love his design!

zsh vim mode with objects!

GitHub - softmoth/zsh-vim-mode: Friendly bindings for ZSH’s vi mode

Out of all the various vim plugins, this is the only one I found that allows to meaningfully work with objects, like ci' etc. Also the mode indicator works very reliably.

Doesn’t conflict with zsh-evil-registers.

English / random

• “expect and require”

Qutebrowser crashing - again

Ubuntu 18.04, qutebrowser etc, as usual. What helped was creating the environment with these options:

python3 scripts/mkvenv.py --pyqt-version 5.14

jq | less zsh alias

Should’ve done this a long time ago:

lq() {
    jq . "$1" -C | less
}

kitty terminal copy url

From config; I should use them more.

# Select a filename and copy it 
map kitty_mod+p>c kitten hints --type path --program @
#: Select a path/filename and open it with the default open program.
map kitty_mod+p>o kitten hints --type line --program -

update-alternatives & installing another gcc

Nicely described: How to switch between multiple GCC and G++ compiler versions on Ubuntu 20.04 LTS Focal Fossa - LinuxConfig.org

# install stuff
$ sudo apt -y install gcc-7 g++-7 gcc-8 g++-8 gcc-9 g++-9
# Add it to update-alternatives
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-7 7
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-7 7
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-8 8
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-8 8
sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-9 9
sudo update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-9 9

# choose the default one
$ sudo update-alternatives --config gcc
There are 3 choices for the alternative gcc (providing /usr/bin/gcc).

  Selection    Path            Priority   Status
------------------------------------------------------------
  0            /usr/bin/gcc-9   9         auto mode
  1            /usr/bin/gcc-7   7         manual mode
* 2            /usr/bin/gcc-8   8         manual mode
  3            /usr/bin/gcc-9   9         manual mode
Press  to keep the current choice[*], or type selection number:

From the docs: --install link name path priority

Python pip

Editable installations (pip install -e .) are a thing. TODO - learn more about them.

Qutebrowser config - adding bindings for tabs 20-30

Given that the standard ones are not enough for me, and even my additional ones for 10-20 are not enough, added a third level:

config.bind('1', 'tab-focus 1')
config.bind('2', 'tab-focus 2')
config.bind('3', 'tab-focus 3')
config.bind('4', 'tab-focus 4')
config.bind('5', 'tab-focus 5')
config.bind('6', 'tab-focus 6')
config.bind('7', 'tab-focus 7')
config.bind('8', 'tab-focus 8')
config.bind('9', 'tab-focus 9')
config.bind('0', 'tab-focus 10')
config.bind('<Alt-1>', 'tab-focus 11')
config.bind('<Alt-2>', 'tab-focus 12')
config.bind('<Alt-3>', 'tab-focus 13')
config.bind('<Alt-4>', 'tab-focus 14')
config.bind('<Alt-5>', 'tab-focus 15')
config.bind('<Alt-6>', 'tab-focus 16')
config.bind('<Alt-7>', 'tab-focus 17')
config.bind('<Alt-8>', 'tab-focus 18')
config.bind('<Alt-9>', 'tab-focus 19')
config.bind('<Alt-0>', 'tab-focus 20')
config.bind('<Alt-Ctrl-1>', 'tab-focus 21')
config.bind('<Alt-Ctrl-2>', 'tab-focus 22')
config.bind('<Alt-Ctrl-3>', 'tab-focus 23')
config.bind('<Alt-Ctrl-4>', 'tab-focus 24')
config.bind('<Alt-Ctrl-5>', 'tab-focus 25')
config.bind('<Alt-Ctrl-6>', 'tab-focus 26')
config.bind('<Alt-Ctrl-7>', 'tab-focus 27')
config.bind('<Alt-Ctrl-8>', 'tab-focus 28')
config.bind('<Alt-Ctrl-9>', 'tab-focus 29')
config.bind('<Alt-Ctrl-0>', 'tab-focus -1')

EDIT: Actually, to think of it, in for a penny, in for a pound!

for i in range(30, 60):
    config.bind(','+str(i), 'tab-focus '+str(i))

Takes about 9 seconds to :config-source everything, but then works like a charm! And doesn’t seem to make anything else slower (strangely, even startup is as usual).

pycharm can parse markdown!

Opened a README.md, and see it being rendered nicely to the left. I can also edit it directly. Wow.

Website with references / cheat sheets for a lot of CLI programs

sed Cheat Sheet - very down-to-earth, “praxisnah”, I like it. Except for the idiotic scrolling override animations

jq basics - again

jq Cheat Sheet

• I should use ' for the filter, " for any string elements inside it

• select

  • Get full record if it matches something
  • jq '.results[] | select(.name == "John") | {age}' # Get age for 'John'

• Value VS key-value

  • jq '.something' gets the content of fields something removing the key
  • jq '. | {something}' gets key-value of something
  • Sample:

$ jq '. | select(.tokens[0]=="Tel") | .tokens[]' mvs.json
"Tel"
":"
$ jq '. | select(.tokens[0]=="Tel") | .tokens' mvs.json
[
  "Tel",
  ":"
]
$ jq '. | select(.tokens[0]=="Tel") | {tokens}' mvs.json
{
  "tokens": [
    "Tel",
    ":"
  ]
}

• |keys to extract keys only

jq Cheet Sheet · GitHub also nice TIl that you don’t need jq '. | keys', jq 'keys' etc is enough.

• `‘del(.tokens)’ to delete a key
• Indexing works like in Python, say jq '.[-2:]'
• 'sort_by(.foo)'

I think now I’m ready for the holy of holies: jq 1.4 Manual

• {user, title: .titles[]} will return an array of {user, title} for each value inside .titles[]!
• Putting ()s around an expression means it’ll be evaluated. {(.user): .titles} will use the value of the key user!

$  jq '. | {(.id): .id}' mvs.json
{
  "7574": "7574"
}

• Putting values inside strings with \(foo)

$ echo "[1,2,3]" | jq '"A string \(.)"'
"A string [1,2,3]"

It’s basically synonymous to python3’s f"My f-{string}"

• '.a=23' will produce an output with .a being set to 23. Will be created if not there.
  • No “change” is being done, the actual value is the same; .a in the same filter after a comma will still return the old value.
• |= will “update” the value by running its previous value through the expression:

$ echo '{"one": 23,"two":2}' | jq '.one|=(. | tostring)'
{
  "one": "23",
  "two": 2
}

• slurp mode - instead of returning objects, return a list of objects! For more ‘correct’ json.
  • jq -s to use, and previosu input can be piped through to it!
    • `jq ‘.’ file | jq -s
  • bash - jq: output array of json objects - Stack Overflow say '[...]' can be used for the same thing. - though I can’t get this to work

Python JSON parser + jq compact mode

It didn’t read the jq-generated multi-line output without commas between items, but jq compact mode does one record (without comma and not as part of an array) per line, and this gets parsed correctly!

JQ compact mode is jq -c '.' sth.json

Before:

{
  "id": "7575",
  "ner_tags": [
    "6",
    "6"
  ],
  "tokens": [
    "Tel",
    ":"
  ]
}

After:

{"id":"7575","ner_tags":["6","6"],"tokens":["Tel",":"]}

Linux - creating a directory accessible to multiple users via a group

How to Create a Shared Directory for All Users in Linux

# Create the group
$sudo groupadd project 
# Add user to this group
$sudo usermod -a -G project theuser
# Change the group of the directory
$ sudo chgrp -R project /var/www/reports/
# Turn on the `setGID` bit, so newly created subfiles inherit the same group as the directory
# And rwxrwx-rx
$ sudo chmod -R 2775 /var/www/reports/

Presenting stuff

“Which story do you want to tell?” (Heard at work, from R)

Git get commit message from file

git commit -F filename allows to use a pre-written commit message from a textfile.

i3 scratchpads magic!

You can ‘mark’ windows¹, a la vim, and then use that as filter - no window classes etc needed - for example, for scratchpads!²

So now I have two scratchpads in i3 config:

bindsym $ms+Shift+plus mark "scratch2", move scratchpad
bindsym $ms+plus [con_mark="scratch2"]  scratchpad show

bindsym $ms+Shift+minus mark "scratch", move scratchpad
bindsym $ms+minus [con_mark="scratch"]  scratchpad show

The second one originally was meant to be for Ding, but it’s really nice to have it flexible.