serhii.net

CLi dashboards resources

• Random
  • sindresorhus/sparkly-cli: Generate sparklines ▁▂▃▅▂▇

timewarrior :fill

:fill works not just for moving stuff, but also tracking!

If I tracked A from 11:00 to 11:23 and now it’s 11:30, I can do timew track 2min B :fill - it will create B from the end of the previous one until now, so 11:24 - 11:30.

zsh vi mode search

<C-R> gets vi-mode into search mode, after returning to Normal mode n/N work just as expected to do a case-insensitive search of similar things in history

Choose default google account

How to Change Your Default Google Account on Mac or PC says that the first one I log into will be the default one.

CLI Dashboards

• sqshq/sampler: Tool for shell commands execution, visualization and alerting. Configured with a simple YAML file.
• Termdash - Terminal based dashboard. | GolangRepo
  • keithknott26/datadash: Visualize and graph data in the terminal

iptables / webmin

Webmin is cool and allows to move iptables rules!

wireguard/pihole docker

Title of the year award goes to IAmStoxe/wirehole: WireHole is a combination of WireGuard, Pi-hole, and Unbound in a docker-compose project with the intent of enabling users to quickly and easily create a personally managed full or split-tunnel WireGuard VPN with ad blocking capabilities thanks to Pi-hole, and DNS caching, additional privacy options, and upstream providers via Unbound.

Intellij marking folders as roots

A top-level folder can be excluded, but any of the folders inside it can be marked as something else and that will override the parent! Very sensible decision actually, when I think about it

vim don’t clean clipboard buffer / + register when closing

From SO:¹

autocmd VimLeave * call system("xclip -selection clipboard -i", getreg('+'))

Here vim’s system() command is interesting:

If you pass a second argument like this, Vim will write it to a temporary file and pipe it into the command on standard input.²

In any case, I should really write some alias to be able to use xclip and friends by passing parameters to them, not piping stuff - makes any kind of scripting with them much harder.

And to finish, Learn Vimscript the Hard Way seems to be still an excellent introduction to vim itself, even without the scripting part.

ag/grep output only capturing groups

This³ describes how to get ag to output not the match, but only a specific capturing group inside it:

ag -o 'https://\K.*?(?=")'

It uses PCRE features to remove stuff from before and from after the match:

• \K resets the match start
• (?=") sets the end to " - here, " is what should be after the match, but will not be included in it.

PCRE

Related is Learn PCRE in Y Minutes. PC in PCRE stands for “Perl Compatible”.

PCRE can be enabled in grep by doing grep -P, and it’s the default in ag.

General DVC notes

• Access:
  • Can directly get stuff from a repo when not inside a dvc project environment
    • Such as from within ML or code
    • Git repo has to be accessible ofc
  • DVC import - same as above, but also gets the metadata
    • Needs to be inside a DVC repo
      • Or have to do git init & dvc init first
  • Python bindings exist
• Stages:
  • Nice and neat
  • parameters.yaml
  • See parametrization below for maybe easier ways to pass parameters
  • Otherwise you just have your script read parameters.yaml, and version parameters.yaml too

DVC parametrization

Parametrization · iterative/dvc Wiki is an experimental feature.

Allows to call parameters directly, such as:

stages:
  build:
    foreach: ${models}
    do:
      cmd: >- 
          python script.py
          --out ${item.filename}
          --thresh ${item.thresh}
      outs:
          - ${item.filename}

as opposed to getting your program to read parameters.yaml

Ipset ipv6 ranges; online subnet ip calculators

IPSet set structures: wiki.ipfire.org - IPset To create an ipv6 ipset that supports domain ranges, we need the hash:net one:

ipset create my6 hash:net family inet6

Nice subnet calculators:

• IPv6 Subnet Calculator - Vultr.com
• IP Calculator / IP Subnetting

iptables doesn’t do ipv6, but ip6tables does, seems to be installed by default along with vanilla iptables. Commands seem to be identical.

Iptables persistent

• iptables-save > some_output_file to save them to a file (this alone doesn’t make it persist reboots)
• The packageiptables-persistent does what is says on the label,¹ for rules being saved in:
  • /etc/iptables/rules.v4
  • /etc/iptables/rules.v6

Ipset save and restore

ipset save > output_file
ipset save -f output_file

ipset restore -f output_file
ipset restore < output_file

The output files it generates seem to be the exact commands without the leading ipset ?

iptables and ipset persistence on yunohost

Looked into yunohost’s recommendations, there’s a best practice.² Created a shell script that does ipset restore -f file and then runs the iptables commands, put it into /etc/yunohost/hooks.d/post_iptable_rules/99-specific_rules. Survived a reboot, mission accomplished.

mktemp for temporary files

> mktemp /tmp/somescript.XXXX
/tmp/somescript.6Zxi

mktemp creates random files with a set format, replacing the XXX with random characters, and returns the filename (+ can also create directories). Cool!

Python env variables

theskumar/python-dotenv: Get and set values in your .env file in local and production servers.

duc for visualizing disk space

Duc: Dude, where are my bytes! - both GUI and cli interface. Love it!

bash - running multiple processes in parallel

#!/bin/bash
run_command(){
	echo "The thing that will be run in parallel"
}

for i in {1..20}
do
	run_command $i &
done
 

Awesome Quantified Self

What do I need?

• Something self-hosted to:
• … transparently and seamlessly track stuff, kinda like android Nomie in the good old days, but with web and android support
• … easily send/receive stuff using an API for my own visualizations

Options:

• Stuff
  • ActivityWatch/activitywatch: The best free and open-source automated time tracker. Cross-platform, extensible, privacy-focused.: Awesome, self-hosted, selfspy-like for all platforms I care about
  • onejgordon/flow-dashboard: A goal, task & habit tracker + personal dashboard to focus on what matters
    • Has a REST API: Flow Dashboard · Apiary
    • Needs a Google Cloud to set up locally?..
  • heedy/heedy: An aggregator for personal metrics, and an extensible analysis engine self-hosted, aggregates stuff from plugins
    • Plugins seem to be easy to write
  • Your Body’s Dashboard | BetterSelf - yet another self-hosted dashboard - unclear where it gets the data from though
    • Source code in a repo with other stuff, this seems to be it? open/open/core/betterself at master · jeffshek/open
    • Web works through the website, android app in progress I guess?
    • Hard to add activities through the website, nice otherwise
  • Wakame/wakapi
    • Has OSS backend: muety/wakapi: 📊 A minimalist, self-hosted WakaTime-compatible backend for coding statistics
    • Wakame itself has infinite editor plugins
  • Human Programming Interface | beepb00p - person solving all of my problems on a much deeper level. Python package getting stuff from all sources I can think of & unifying them. The Internet is truly a wondeful place
  • Frieds is about tracking time spent with people, local, cli: JacobEvelyn/friends: Spend time with the people you care about. Introvert-tested. Extrovert-approved.
    • Really nice and based on a single markdown file
  • sarifsystems/sarif: A distributed system serving as a personal assistant - more like a personal assistant, as open as it gets, feels very expandable
• Meta
  • woop/awesome-quantified-self: Websites, Resources, Devices, Wearables, Applications, and Platforms for Self Tracking list
• Other
  • Nice but not self-hosted: everyday | FAQ
  • karlicoss/promnesia: Another piece of your extended mind web browser extension to give context about the page based on HPI data, much cooler than I can describe here
• Specific websites
  • karlicoss/rexport: Reddit takeout: export your account data as JSON: comments, submissions, upvotes etc. 🦖

Random:

• Would be nice if somehow the TOREADs from DTB got parsed, my added links from wallaby got parsed, all would live on serhii.net/f/? ..or somewhere else
  • More abstractly and better about the same sentiment: The sad state of personal data and infrastructure | beepb00p
• How would that play with morning/evening pages, weekly reviews, checklists? They’d be their own data source to..?

Friends

JacobEvelyn/friends: Spend time with the people you care about. Introvert-tested. Extrovert-approved. is really nice!

> friends add activity three days ago: Some activity three days ago                                                      <<<
Activity added: "2021-05-30: Some activity three days ago"

# also works:
> friends list activities --since="two month ago"

As with taskwarrior, things can get arbitrarily shortened as long as they remain unique! friends a ac "some activity" (you can add both an activity and an alias)

Firefox for Android - using the old extensions! (And Fennec)

Found this: How to use collections on addons.mozilla.org | Firefox Help

TL;DR create an extension collection on Firefox’s website, then from Fennec or Firefox Nightly they can be installed! Wooooohooo!

Also TIL about Fennec - seems like a Firefox fork without features that are ‘considered harmful’

Taskwarrior logging an already completed task

task log adds a task and sets its status to completed! ¹

As a bonus, tasks that don’t have a specific tag are task -notthistag list

Git add vim swap files to .gitignore

To add all the swapfiles generated by vim (.swp, .swo, etc) to gitignore:²

.*.sw*

Here’s also interesting Github’s own .gitignore for vim files: gitignore/Vim.gitignore at master · github/gitignore

Python graph library

graph-tool: Efficent network analysis with python looks like a really good and modern graph theory library for python

Docker mounting when developing, so as not to rebuild the image after each change

You Don’t Need to Rebuild Your Development Docker Image on Every Code Change · vsupalov.com

Pytorch memory leak when doing CPU inference

Got solved by using jemalloc instead of malloc. … No idea why and how that works.

Linux youtube client “red” / “utube”

keshavbhatt/red: Red - Privacy focused Youtube player and download manager for Linux, uses youtube-dl as backend. afaik it’s snap-only.

Unstable and crashes a lot though :(

python glances

Glances · PyPI is a htop-like monitoring thingy.

qutebrowser clear data for a specific website

Can be done through dev tools! Clear all site data, just cookies, or anything else. [^qbprivgithub ]

Learning git

Will be using the old and awesome Git - Book and a small test local repo.

2.2 Git Basics

git status -s is short git status

Docker DEBIAN_FRONTEND=noninteractive

Setting it in Dockerfiles is discouraged (even by the official Docker FAQ ¹) because it’s mainly cosmetic & may create unwanted side effects.

For me, tzdata wanted input and waited for it:

[17:01:56][Step 1/3] debconf: falling back to frontend: Readline
[17:01:56][Step 1/3] Configuring tzdata
[17:01:56][Step 1/3] ------------------
[17:01:56][Step 1/3] 
[17:01:56][Step 1/3] Please select the geographic area in which you live. Subsequent configuration
[17:01:56][Step 1/3] questions will narrow this down by presenting a list of cities, representing
[17:01:56][Step 1/3] the time zones in which they are located.
[17:01:56][Step 1/3] 
[17:01:56][Step 1/3]   1. Africa      4. Australia  7. Atlantic  10. Pacific  13. Etc
[17:01:56][Step 1/3]   2. America     5. Arctic     8. Europe    11. SystemV
[17:01:56][Step 1/3]   3. Antarctica  6. Asia       9. Indian    12. US

Fixed this by adding this command specifically before the one requiring it:

RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y

vaex - faster panda-like lib

TODO: Vaex: Pandas but 1000x faster - KDnuggets

Looks interesting. Why is it faster?

python subprocess run

subprocess.run() is the newer version of ..call(). Can run a string like this:

subprocess.run("echo  one two three", shell=True)

Qutebrowser throwaway email and password generatorr userscripts

Generate password, paste it into a textfield, and xclip the output:

#!/usr/bin/python3
import os
import string
import secrets
from subprocess import run
alphabet = string.ascii_letters + string.digits
password = ''.join(secrets.choice(alphabet) for i in range(8))

run(f"echo {password} | xclip -selection c", shell=True)
with open(os.environ['QUTE_FIFO'], 'w') as f:
    f.write(":insert-text {}".format(password))

Generate a throwaway email with email based on domain (so if I were to run it on google.com, it’d generate google@wildcard.mydomain.net:

#!/usr/bin/python3
import os
import tldextract
import argparse
import sys

argument_parser = argparse.ArgumentParser()
argument_parser.add_argument('--subdomain', '-s', default='t',
                             help='subdomain ("t" would do "@t.email_host.net")')
argument_parser.add_argument('--email_host', '-d', default='email_host.net',
                             help='main domain where you\'ll get the emails')
argument_parser.add_argument('--username', '-u', default=None,
                             help='the name used for email username (name@...)')
def main(args):
    my_domain = args.email_host
    subdomain = args.subdomain
    if args.username is not None:
        username = args.username
    else:
        url = os.environ['QUTE_URL']
        extract_result = tldextract.extract(url)
        username = extract_result.domain

    address = f"{username}@{subdomain}.{my_domain}"

    with open(os.environ['QUTE_FIFO'], 'w') as f:
        f.write(":insert-text {}".format(address))

if __name__ == '__main__':
    arguments = argument_parser.parse_args()
    sys.exit(main(arguments))

Use-case for both - quick easy registration in pointless places.