• Goal: centerline trace pngs
• Inscape
  • Script, extension, now part of Inkscape: inkscape-centerline-trace/centerline-trace.py at master · fablabnbg/inkscape-centerline-trace
  • Inkscape as a purely command line tool : r/Inkscape reddit on using the CLI and running the extension standalone and how it doesn’t really work
  • Can’t get it to work using CLI either, there’s just bitmap-trace that has no centerline option
• Not inkscape
  • autotrace/autotrace: bitmap to vector graphics converter
  • Potrace
    • no centerline

Autotrace is awesome!

This alone works really nicely:

autotrace -centerline AMPERSAND.png  -output-file AMPERSAND.svg

Fish script for batch processing, courtesy of ChatGPT:

#!/usr/bin/fish

# Check if autotrace is installed
if not type -q autotrace
    echo "autotrace is not installed. Please install it first."
    exit 1
end

# Loop through each .png file provided as an argument
for file in $argv
    # Check if the file extension is .png
    if string match -r '\.png$' $file
        # Set the output filename by replacing .png with .svg
        set output_file (string replace -r '\.png$' '.svg' $file)

        # Execute autotrace with centerline option
        autotrace -centerline $file -output-file $output_file

        # Confirmation message
        echo "Processed $file to $output_file"
    else
        echo "Skipping $file: not a .png file"
    end
end

And a more simple one:

#!/usr/bin/fish
for file in $argv
    autotrace -centerline $file -output-file "$file.svg"
end

Options

ChatGPT says this:

autotrace -centerline -input-format png -output-format svg -output-file traced_dejavu.svg -dpi 300 -error-threshold 0.5 -corner-threshold 85 -filter-iterations 2 -noise-removal 0.99 -line-threshold 0.5 -corner-surround 3

(et 1 is best)

Using the Command Line - Inkscape Wiki

• inkscape action-list shows all available actions

• man inkscape is the latest and best

• inkscape AMPERSAND.png --export-type="svg" --export-area-page --batch-process works but asks me about import options

inkscape --shell, man page gives examples:

file-open:file1.svg; export-type:pdf; export-do; export-type:png; export-do
                   file-open:file2.svg; export-id:rect2; export-id-only; export-filename:rect_only.svg; export-do

OK this works for no questions about how to import it:

> file-open:AMPERSAND.png
> export-filename:AM.svg
> export-do

• Quarto markdown is a superset of pandoc markdown, unrelated article about the latter: Everything pandoc Markdown can do
• Pandoc has a python library: Pandoc (Python Library)
• panflute is a more python way to parse docs and write pandoc filters, and I love it: User guide — panflute 2.3.0 documentation

I missed an ability to recursively look for elements matching a condition in panflute, so:

def _recursively_find_elements(
    element: Element | list[Element], condition: Callable
) -> list[Element]:
    """Return panflute element(s) and their descendants that match conditition.
    """
    results = list()

    def action(el, doc):
        if condition(el):
            results.append(el)

    if not isinstance(element, list):
        element = [element]

    for e in element:
        e.walk(action)


    return results

# sample condition
def is_header(e) -> bool:
	cond = e.tag == "Header" and e.level == 2  # and "data-pos" in e.attributes
	return cond

Ah, to read:

ddoc = pf.convert_text(
	markdown,
	input_format="commonmark_x+raw_html+bracketed_spans+fenced_divs+sourcepos",
	output_format="panflute",
)

To output readably:

pf.stringify(el).strip() 

Pandoc/panflute get line numbers of elements

• input_format has to be commonmark[_x]+sourcepos
  • sourcepos isn’t too well documented, only w/ commonmark
  • it basically sets el.attributes['data-pos'] a la 126:1-127:1
  • line_no always matching what I expect

def _parse_data_pos(p: str) -> tuple[tuple[int, int], tuple[int, int]]:
	"""Parse data-pos string to (line, char) for start and end.
	
	Example: '126:1-127:1' -> ((126, 1), (127, 1))
	
	Arguments:
		p: data-pos string as generated by commonmark+sourcepos extension.
	"""
	start, end = p.split("-")
	start_l, start_c = start.split(":")
	end_l, end_ch = end.split(":")
	return (int(start_l), int(start_c)), (int(end_l), int(end_ch))

One control, play/pause.

const buttons = document.querySelectorAll('.play-pause-btn');

buttons.forEach(button => {
    const audio = document.getElementById(button.dataset.audio);

    button.addEventListener('click', () => {
        if (audio.paused) {
            // Pause all other audio files
            document.querySelectorAll('audio').forEach(a => {
                a.pause();
                a.currentTime = 0; // Reset other audio files
            });
            document.querySelectorAll('.play-pause-btn').forEach(btn => {
                btn.textContent = '▶';

            });

            // Play the clicked audio
            audio.play();
            button.textContent = '⏸︎';

        } else {
            audio.pause();
            button.textContent = '▶';
        }
    });

    // Reset button icon when audio ends
    audio.addEventListener('ended', () => {
        button.textContent = '▶';
    });
});

Multiple players:

<div class="player-container">
	<button class="play-pause-btn" data-audio="audio1">▶️</button>
	<audio id="audio1" src="audio1.mp3"></audio>
</div>

<div class="player-container">
	<button class="play-pause-btn" data-audio="audio2">▶️</button>
	<audio id="audio2" src="audio2.mp3"></audio>
</div>

.player-container {
    display: inline;
    vertical-align: text-bottom;
    align-items: center;
    margin-bottom: 20px;
}
.play-pause-btn {
    font-size: 32px;
    background: none;
    border: none;
    cursor: pointer;
    margin-right: 10px;
}

Fish Shell function for sourcing standard .env files :

 . (sed 's/^/export /' .env | psub)

(And yet another mention of Taskfile that I’ll definitely look into nowG)

I want to automatically get the PDF version of quarto/reveal presentations. The usual way would be to open the presentation in export mode e, then print with no margins through the usual print window.

I want to do this automatically as part of a CI/CD pipeliene.

Options

• Generate PDF from revealjs presentation (consistent with PDF Export in revealjs) · quarto-dev/quarto-cli · Discussion #7018
• selenium-print · PyPI / bubblegumsoldier/selenium-print uses selenium+chromium to do this.
• PDF Export | reveal.js
  • Support other PDF export tools for revealjs (e.g decktape) · Issue #4677 · quarto-dev/quarto-cli

Selenium-print

selenium-print · PyPI / bubblegumsoldier/selenium-print uses selenium+chromium to do this.

As for the printing options available in Chrome, this looks relevant:

selenium-print/seleniumprint/drivers/chrome_pdf_driver.py at main · bubblegumsoldier/selenium-print

        pdf = self.driver.execute_cdp_cmd("Page.printToPDF", {"printBackground": True})

OK, so it’s all a static option.

Chrome DevTools Protocol - Page domain has the other available options — which is what I need.

The rest of the code feels like a wrapper to this — maybe I can drop the entire library and just use these single bits?

Decttape (?)

• Generate PDF from revealjs presentation (consistent with PDF Export in revealjs) · quarto-dev/quarto-cli · Discussion #7018

• Command substitutions and variables: Fish for bash users — fish-shell 3.7.1 documentation
• string collect: string-collect - join strings into one — fish-shell 3.7.1 documentation
• SO: Read file into environment variable? · Issue #7323 · fish-shell/fish-shell:

set VARNAME (cat ~/myfile | string collect)

Here string collect makes sure it’s a multiline variable instead of an array composed of one element per line.

TL;DR use your own personal settings, then “dev settings” (!), then create one but set the resource owner to the organization.

(As of 2024-10-14. Hard to find clear AND CORRECT documentation on this.)

Create access token for organization · community · Discussion #74701.

Gitlab mirroring didn’t work for me after trying for hours, I give up. CI/CD it is.

• Refs:
  • Predefined CI/CD variables reference | GitLab
  • How do I push to a repo from within a gitlab CI pipeline? - Stack Overflow

• Font Finder By Image — Fontspring Matcherator allows manually specifying glyphs and shows all paid fontns
• WhatTheFont Font Finder - Identify Fonts by Image is the very best, instantly parsed the noisy image and the fonts looked much closer (and found some very famous ones missed by the first)

On a slow connection or other constraints, you can check out only the last N commits or only a specific branch:

git clone --depth 3 --branch some-branch https://some-repo.org

Git - git-clone Documentation

TIL¹:

• ./git/info/exclude is your local .gitignore outside the repository tree!
• git update-index --assume-unchanged .gitignore makes git stop checking the changes for that file in the working tree. --no-assume-unchanged to take it back.²³

Finally a place for my local ignores that won’t appear in autocomplete suggestions for git add and friends. In Pycharm I have changelists, and now I finally have a solution for my just-as-usual vim/git/CLI workflow as well.

BUT:

• exclude won’t work if the file is already tracked (says SO but for me it works?..)

As of 2024-10-02 20:16 at least.

give me the ag command to look inside markdown and yaml files only

GPT4o¹:

`ag --include='*.md' --include='*.yaml' --include='*.yml' 'search_pattern'`

GPT4²:

`ag "search_pattern" --markdown --yaml`

github/git-sizer: Compute various size metrics for a Git repository, flagging those that might cause problems (linked by Repository limitations and recommendations)

TL;DR too many files? too large one? too many tags? Find out!

yay took forever to compress pycharm. Like, 5-10 mins at least.

TODO documentation, but if you don’t care about package size but care about speed, this will speed up everything considerably:

PKGEXT='.pkg.tar' yay -S pycharm-professional

Wanted to do sth like this all the time, but the help basically told me to copypaste multiple arguments etc.

Will come back to bite me but nice to have the option I guess

Question: How can I install packages without having to confirm? · Issue #1033 · Jguer/yay:

echo y | LANG=C yay --noprovides --answerdiff None --answerclean None --mflags "--noconfirm" $PKGNAME

(--noconfirm is not documented in help and man, and of course can create problems¹)

BUT ALSO

yes is a command that exists.

Then: yes | yay ... or yes | LANG=C yay

And generally really neat to have a command for answering “yes” to prompts.

And then quick unsafe bad dangerous command to update everything that includes 241001-1512 Yay better compression algos:

echo y | LANG=C PKGEXT='.pkg.tar'  yay  --answerdiff None --answerclean None --mflags "--noconfirm"

• You can share lists in Google Maps, making them editable by everyone with a google account
• Google My Maps is much cooler, with layers etc

Google My Maps

• Really nice tutorial on everything: Visualize your data on a custom map using Google My Maps – Google Earth Outreach
• To share it editable, you share -> Share on Drive
• drag and drop doesn’t always work
• style and colors
  • layer can be styled uniformly (easy)
  • style by data column: per-field, e.g. description, like a groupby
  • individual styles per element
• you can drag and drop items between layers only if they’re styled individually??
• If you style by e.g. description, assign icons/colors, then style individually to move them, then back to style by description, it seems to save the previous settings

In pycharm, updated black to use these args: --preview --enable-unstable-feature string_processing $FilePath$

The (future of the) Black code style - Black 24.8.0 documentation has both the preview style and the unstable features one can enable (by passing the flag multilple times).

string_processing breaks long strings into multiple shorter ones, one on each line.

• Useful:

  • Running mypy and managing imports - mypy 1.12.0+dev.ecfab6a02415c46eda5717ec6ee9bfac8115c1e9.dirty documentation evergreen
  • Error codes - mypy 1.12.0+dev.ecfab6a02415c46eda5717ec6ee9bfac8115c1e9.dirty documentation
  • The mypy configuration file - mypy 1.12.0+dev.ecfab6a02415c46eda5717ec6ee9bfac8115c1e9.dirty documentation

• mypy cares about packages, especially __init__.py files — the uppermost dir with such a file will be the root package. See Mapping files to modules - Running mypy and managing imports - mypy 1.12.0+dev.ecfab6a02415c46eda5717ec6ee9bfac8115c1e9.dirty documentation

• This is needed to do per-package configs

[mypy-mycode.package.etc]
disable_error_code = attr-defined, union-attr

• Problem: the pycharm extension I have crashes in the last version. :(

• Main and best: python - How to run Pylint with PyCharm - Stack Overflow

  • idea of multiple ’external tools’ for diff pylint options: HOWTO - Setup pylint with PyCharm and the PyLint Plugin

My changes:

• arguments: --msg-template="{abspath}:{line:5d},{column:2d}: {C}/{msg} ({symbol})" --output-format=colorized "$FilePath$"
  • note ", otherwise it failed for me, and {C} — for the message class see man page (or below) for list of format string options.
• output filters for on-click: $FILE_PATH$:\s*$LINE$\,\s*$COLUMN$

I had two options as separate tools:

• pylint for a single file
• pylint for the module — same as above, but
  • with $FileParentDir$ at the end.
  • --recursive=y — fails on no __init__.py otherwise

Worked neatly with a .pylintrc file in repo root with e.g.

[tool.pylint.main]

[tool.pylint.basic]
# "too-few-public-methods", disable
min-public-methods=0

function-naming-style="camelCase"
argument-naming-style="camelCase"
method-naming-style="camelCase"
variable-naming-style="camelCase"
attr-naming-style="camelCase"

[tool.pylint."messages control"]
disable = [
    "fixme",  # TODOs
    "import-error",  # runner has them in its environment
    "import-outside-toplevel",  # explicit requirement of XXX to import where used
    "duplicate-code"  # entangling different extensions/modules is not the solution
]

Pylint format string options from man pylint:

path   relative path to the file

abspath
	  absolute path to the file

line   line number

column column number

end_line
	  line number of the end of the node

end_column
	  column number of the end of the node

module module name

obj    object within the module (if any)

msg    text of the message

msg_id the message code (eg. I0011)

symbol symbolic name of the message (eg. locally-disabled)

C      one letter indication of the message category

category
	  fullname of the message category

For example, the former (pre 1.0) default format can be obtained with:

  pylint --msg-template='{msg_id}:{line:3d},{column}: {obj}: {msg}'

Bonus

If I have this post open, I’ll need this one anyway: Messages control - Pylint 4.0.0-dev0 documentation

So Slicer seems to use both and I need to as well, so I’ll have to learn that sooner or later.

• VTK
  • VTK advertises their Book, available online, which looks like an excellent intro about everything, terminology etc.
    • Chapter 5 - Data Representation — VTK Book
  • wiki: VTK/Tutorials - KitwarePublic but superficially less useful to me?..
• ITK

  • open-source, cross-platform library that provides developers with an extensive suite of software tools for image analysis (About | ITK)

  • Python Quick Start - ITK’s documentation

  • Examples — v5.4.0

    • Common especially has interesting things like add noise etc.: Examples — v5.4.0

  • there’s a python package docu:

    • Quick start guide — ITKPythonPackage documentation
• Slicer
  • Slicer examples as usual as always: Script repository — 3D Slicer documentation
    • Segment effects! Script repository — 3D Slicer documentation
      • Fills all internal holes inside segments. For example, fills in empty regions inside vertebral bodies segmented with Grow from seeds with intensity-based masking.
        • shows many other cool useful things as well, incl. adding segments

Is ‘file’ a keyword in python? - Stack Overflow

TL;DR python3 doesn’t care about file, regardless of what syntax highlighters think about this.

TL;DR:

• pydocstyle != flake8-docstrings · PyPI!
• read the pypy documentation
• docstring-convention=google in flake8 config file, ignores there as well together with the rest.

pydocstyle / python-flake8-docstrings is a thing. Forgot I had it installed and spent a lot of time trying to understand pycharm’s output

Usage — pydocstyle 0.0.0.dev0 documentation flake8-docstrings · PyPI

To ignore things, you don’t do:

[pydocstyle]
convention = google
ignore = D401

It’s either ignore or convention. Which quietly happened in the background, and I thought it doesn’t read my config file since D401 was still shown.

Correct would be this:

[pydocstyle]
convention = google
add-ignore = D401

EDIT GodDAMN it, pydocsyle parsing a config file doesn’t mean that flake8(-..docstring) will.

Reading the flake8 plugin docs, I should add THIS and to flake8 config file. Ignores also are set up there using the usual way.

docstring-convention=google

And the pydoctest config file search and add-ignore is irrelevant. God lost so much time to this

EDIT: this may be all wrong, in the debugger I can just edit the code and it gets automatically used by slicer — logical, since it’s just a CLI script.

It’s the .xml with the interface that’s problematic and it can’t be reloaded using the method below, or at least I couldn’t.

A scriptedcli module imported to Slicer doesn’t show for me the usual “reload” buttons as seen in scripted modules in dev. mode. To develop, I need my changes I need to reload it w/o restarting 3dslicer.

Based on this more complete example¹ linked in the script repository²

>>> mpath = "/full/path/to/the/my_module.py"
>>> factoryManager = slicer.app.moduleManager().factoryManager()
>>> factoryManager.registerModule(qt.QFileInfo(mpath))
>>> factoryManager.loadModules(["my_module"])
True

BONUS:

• To debug such a module using pycharm, adding the pydev lines inside it works (and official slicer debug extension doesn’t):

import pydevd_pycharm
pydevd_pycharm.settrace('localhost', port=5678, stdoutToServer=True, stderrToServer=True)

Links

• GUI
  • XML reference Documentation/Nightly/Developers/SlicerExecutionModel - Slicer Wiki

Debugging

TL;DR Pycharm Professional instructions work

• These instructions: SlicerRt/SlicerDebuggingTools: Extension for 3D Slicer containing various tools for module development and debugging¹
  • No need to change anything in module code
• During debugging everything freezes
• You can use pycharm python CLI to look around etc. — neat!

not TL;DR

• SlicerRt/SlicerDebuggingTools: Extension for 3D Slicer containing various tools for module development and debugging¹
  • needs pycharm Pro
  • SlicerDebuggingTools/PyDevRemoteDebug/PyDevRemoteDebug.py at master · SlicerRt/SlicerDebuggingTools
  • source of the 3dslicer bits
• pdb-attach · PyPI can attach to random programs,
  • os.getpid() is my friend
• Documentation/4.5/Developers/FAQ/Python Scripting - Slicer Wiki at some point it was possible to use python-remote-pdb
• ionelmc/python-remote-pdb: Remote vanilla PDB (over TCP sockets). 2y ago last commit
• I can use these same instructions mostly for pdb-attach, I see no reason it shouldn’t work, python is python
• it Kiiiinda works but breaks after the first button
• Giving up for now
• Update: installed Pycharm Pro, works!
  • Pycharm Pro egg was in /opt/pycharm-professional/debug-eggs/pydevd-pycharm.egg

Basics

Starting Slicer

Loads the module automatically (for some reason doing it manually doesn’t preserve it across restarts?..)

Slicer  --additional-module-path /path/to/my/extension/one/lower/than/what/i/would/pick/in/Slicer/GUI

Logging

• Not directly mentioned in the help because they state it’s always better to use the debugger²
• Slicer/Base/Python/slicer/slicerqt.py at main · Slicer/Slicer has the slicer setup
• I can do logging.warning("test") in the python console and it works
• Slicer settings allow changing the loglevel of its python console!

Module types: CLI modules

Different types of modules exist: Module Overview — 3D Slicer documentation

In the first tests there was a lot of latency.

Solution: CLI modules (not extensions) that can run in the background and whose status can be queried, which can be added to new extension from extension editor.

Now I understad this better:

• CLI modules are simple I/O, non-blocking, that’s where the networkig logic should go to
• scripted are python scripts with GUIs

• This bit about running CLI in the backgroundPython FAQ — 3D Slicer documentation

Looking into the sample code

Module of type scripted

• Created an extension of type cmake, to which I added a module of type scripted. It’s the sample thresholding extension
  • Base class: Slicer/Base/Python/slicer/ScriptedLoadableModule.py at main · Slicer/Slicer
• Sample data
  • It shows how to add sample data to the extension for testing
  • It can then be found in the Sample Data module, named after the extension itself!

Module of type scriptedCLI

• I hope it’s the same as type CLI, but only with python

• I think it’s lassoan/SlicerPythonCLIExample: Example extension for 3D Slicer that demonstrates how to make a Python script available as a CLI module

• Is a CLI script w/ an XML that has module metadata + examples

  • CLI module goes in the same examles menu
  • and a basic UI has been generated for it? Wow
  • Running it from the UI actually shows a progress bar and it doesn’t block the interface! Woohoo!

• Adding it added it to CMakeLists.xml: add_subdirectory(my_scripted_cli)

• python dev tools actually show the CLI used to run a CLI module!

  • the input arguments are filepaths, and slicer automatically generates and then deletes temporary files for this when running

• can’t debug it the usual way, I guess I’ll have to add the pydevd-pycharm things to the code

[VTK] /opt/3dslicer/bin/python-real /home/.../cli_model_service.py /tmp/Slicer-sh/IACHCI_vtkMRMLScalarVolumeNodeD.nrrd 1 /tmp/Slicer-sh/IACHCI_vtkMRMLScalarVolumeNodeF.nrrd 

(Auto-creating) GUI

• Slicer/Docs/developer_guide/parameter_nodes/gui_creation.md at main · Slicer/Slicer seems interesting

• CLI modules have an interface specified by the .xml file, and the interface is generated based on it

  • couldn’t find any documentation on how to write the XML: Documentation/Nightly/Developers/SlicerExecutionModel - Slicer Wiki

• Bits about the XML

  • channel is either input or output, and only for pics.
  • No parameter names, just their index

• If I read the volume as volume, it uses the .nrrd file extension by default — and I want .nii

  • Script repository deals with these settings, but I can’t use them from within a CLI module Script repository — 3D Slicer documentation

Auto-loading the module at startup

Module from console with arguments - Support - 3D Slicer Community

Slicer.exe --python-code "selectModule('SampleData'); getModuleGui('SampleData').setCategoryVisible('BuiltIn', False)"

File operations

Script repository — 3D Slicer documentation:

# Create a new directory where the scene will be saved into
import time
sceneSaveDirectory = slicer.app.temporaryPath + "/saved-scene-" + time.strftime("%Y%m%d-%H%M%S")
if not os.access(sceneSaveDirectory, os.F_OK):
  os.makedirs(sceneSaveDirectory)

Inspiration

• User_Manual.md · develop · OpenDose / SlicerOpenDose3D · GitLab
  • openDose3D is a cool example extension that shows many things
• SlicerTotalSegmentator/TotalSegmentator/TotalSegmentator.py at main · lassoan/SlicerTotalSegmentator

  		outputSegmentation.AddDefaultStorageNode()
  		outputSegmentation.GetStorageNode().SetFileName(output_segmentation_path)
  		outputSegmentation.GetStorageNode().ReadData(outputSegmentation)
  

Useful bits from documentation

• There’s a node type for tables
  • statistics become a table
  • also: many modules exist
    • Documentation/Nightly/Extensions/MeshStatistics - Slicer Wiki / DCBIA-OrthoLab/MeshStatisticsExtension
      • does a lot including creating a table GUI programmatically and CSV export etc.
• Colors: are not just colors, but class/label names as well

• Main links

  • Extensions — 3D Slicer documentation¹
  • Extensions Manager — 3D Slicer documentation²

• slicerrc.py is a thing! sample: 3D-Slicer-Scripts/.slicerrc.py at master · jzeyl/3D-Slicer-Scripts · GitHub

• Slicer custom application deployment to many computers - Development - 3D Slicer Community

  • SlicerQReads.exe --python-code "folder='S:\SlicerQREADS\TestImages'; import os; slicer.util.loadVolume(folder + '/' + os.listdir(folder)[0], {'singleFile': False})"
  • alternatively: Slicer.exe --python-script "/full/path/to/myscript.py" --no-splash --no-main-window³

• Slicer can run in Docker⁴

• Slicer can run in webbrowser⁵

• Slicer can run in jupyter⁵, including partially (e.g. only a single view etc!)

Slicer --help:

  --testing                                     Activate testing mode. It implies --disable-settings and --ignore-slicerrc. (default: false)
  --disable-python                              Disable python support. This is equivalent to build the application with Slicer_USE_PYTHONQT=OFF.
  --python-script                               Python script to execute after slicer loads.
  --python-code                                 Python code to execute after slicer loads.
  -c                                            Python code to execute after slicer loads. By default, no modules are loaded and Slicer exits afterward.
  --ignore-slicerrc                             Do not load the Slicer resource file (~/.slicerrc.py).
  --additional-module-path                      Additional module path to consider when searching for modules to load.
  --additional-module-paths                     List of additional module path to consider when searching for modules to load.

• Slicer modules — todo, CLI things with easy arguments

  • Documentation/Nightly/Developers/Modules - Slicer Wiki

• Slicer extensions/modules creation

  • Developing extension in 3D Slicer - Google Slides presentation
    • 
    • Sharing extensions there: TL;DR use slicer publishing thing to publish to own repo, then PR to slicer main extensions index repo (GitHub - Slicer/ExtensionsIndex: Slicer extensions index)
      • Sample JSON: ExtensionsIndex/SurfaceWrapSolidify.json at main · Slicer/ExtensionsIndex · GitHub
      • Pull requests · Slicer/ExtensionsIndex has code for existing recent extensions that may be useful

• Extension manager

  • Extensions Manager — 3D Slicer documentation ²
  • Can have different extension server URI!
  • Updating:
    • Extensions Manager — 3D Slicer documentation
    • TL;D/R extension manager can do that incl. automatically

• CI/CD exists for extensions published officially

• Misc:

  • Script repository — 3D Slicer documentation has sample uses of slicer CLI!
  • 3D-Slicer-Scripts/.slicerrc.py at master · jzeyl/3D-Slicer-Scripts · GitHub

• Script repository — 3D Slicer documentation has this:

  • This code snippet can be useful for sharing code in development without requiring a restart of Slicer.

  • gist.githubusercontent.com/pieper/a9c0ba57de3833c9f5aea68247bda597/raw/82d73d85340ffd205b01fc339b096a8607cfe02b/InstallSlicerModuleFromGit.py
  • TODO, does this mean updating extensions without restart?
  • EDIT: I can reload the code of the extension as-is

• Fazit:

  • extensions can be built (C++) or not (python)
  • enabling:
    • add to CLI path to “additional module paths” path to place where .py extension is locally
      • git pull etc.?
      • get a .zip from the repo and use the python code to get it from there and update
    • make our own extension manager repo thing and use automatic updating functionality

• Other bits

  • Making Slicer simpler by hiding many things: Simple 3D Slicer based image viewer
  • And hiding a module UI: Slicer/Modules/Scripted/DICOMPlugins/DICOMScalarVolumePlugin.py at 022a4f1a347ebb24509a50f6c8928ae26d3c5955 · Slicer/Slicer

inotifywait(1) - Linux man page

#!/bin/sh
while inotifywait --format '%:e %f' p.* *.bib; do
  sleep 1  # files get moved often
  echo "rsync!"
  rsync -avzirh --progress  p.* *.bib me@server.net:dir
done

boltctl monitor shows changes as they happens — nice when something breaks. I used to do a lot of watch boltctl list before in this exact scenario

(having a monitor subcommand in your thing says a lot about stuff, actually, — the best interpretation is that it’s written with developers in mind)

Very proud of this idea, haha :)

For absolute positioned elements one needs to “guess” the correct sizes etc., may not be trivial. Using a pixel ruler won’t help because the .absolute coords don’t map to the screen ones.

Solution:

.grid {
  // https://stackoverflow.com/questions/4191260/drawing-a-grid-using-css
  background-image:
    repeating-linear-gradient(lightblue 0 2px, transparent 2px 100%),
    repeating-linear-gradient(90deg, lightblue 0 2px, transparent 2px 100%);
  background-size: 50px 50px;
  //border: 2px solid red;
}

.smallgrid {
  background-image:
    repeating-linear-gradient(#ccc 0 1px, transparent 1px 100%),
    repeating-linear-gradient(90deg, #ccc 0 1px, transparent 1px 100%);
  background-size: 10px 10px;
  width: 100%;
  height: 100%;
}

::::: {.absolute left=0 right=0 top=0 bottom=0 .grid}
::: {.smallgrid}
:::
:::::

It’s not exactly aligned but close enough to judge the widths and heights involved!

Rectangle in the pic is:

:::: {.redrect .absolute right=200 top=130 width=200 height=100}
::::

(And the small grid can be omitted if not needed by removing the div in the middle. )

For bonus points, can be saved as a file and included if needed:

{\{< include ../_shared/smallgrid.qmd >}\}

ALSO:

// show the border of the slide
.reveal .slides {
  border: 1px dashed red;
}

DAMN.

Figures – Quarto:

:::: {layout="1,1,1],[1],[1,1,1" layout-valign="center"}

if it’s a layout I do get a valign thing. I just have to use layouts, not columns. Damn.

This doesn’t work on SVGs for me:

![](images/02/svgs/02_seqsiii.svg){.absolute top=0 left=0}

This does:

::: {.absolute top=0 left=0}
![](images/02/svgs/02_seqsiii.svg)
:::

SO.

One can literally generate a plot w/ graphviz, export as svg, open and edit in inkscape, save as optimized svg, paste into quarto, and manually add the correct class="fragment" data-fragment-index=4 bits to the relevant groups.

Insert with the usual {=html} thing.

Damn.

LeaderLine

almost works with quarto, except that line.position needs to be called on slide change — ergo likely won’t work in pdf export mode.

maurosilber/pyfragments: Animated figures for Quarto installs as-is

IT WORKS FOR PDF MODE TOO! And uses fragments

# | fig-width: 15
# | fig-height: 10
# | output: asis
import matplotlib.pyplot as plt
from pyfragments import AnimatedFigure

with AnimatedFigure() as ani:
# Data for plotting
  train_loss = [1.0, 0.6, 0.3, 0.2, 0.1]
  val_loss = [1.2, 0.8, 0.5, 0.4, 0.6]
  iterations = [1, 2, 3, 4, 5]

  plt.xlim(0, 6)
  plt.ylim(0, 1.5)

# Labels and legend
  plt.xlabel('Trainingsiterationen', fontsize=14)
  plt.ylabel('Loss', fontsize=14)
  plt.legend(loc='upper right', fontsize=12)

# Plot
  for x in range(len(train_loss)+1):
    with ani.fragment():
      plt.plot(iterations[:x], train_loss[:x], 'bo-', label='Training', linewidth=2)
      plt.plot(iterations[:x], val_loss[:x], 'go-', label='Validation', linewidth=2)

# Add a dashed vertical line in the middle
  mid_iteration = (iterations[0] + iterations[-1]) / 2

  with ani.fragment():
    plt.axvline(x=mid_iteration, color='r', linestyle='--', linewidth=1.5)

I couldn’t make a graph large enough to fill the screen, increasing fig-width didn’t help.

Solution: increase both fig-width and fig-height!

{dot}
//| fig-width: 12
//| fig-height: 9
digraph G {
    rankdir=LR;
	..

Execution Options – Quarto has figure options that lists the default sizes of figures based on output formats. Couldn’t find them because was looking in figures/graphviz etc. pages, not execution. …

For reveal slides, it’s 9 x 5.

Apparently it didn’t want to increase the 5 till I explicitly told it to, then width started increasing as well.

Both superscripts and subscripts

… are hard and you have to use a table.

digraph Neural_Network {
    rankdir=LR;
    ranksep=1.3;
    
    node [shape=circle, style=filled, fontcolor=white, fontsize=25, fillcolor="blue", color="black"];

    subgraph cluster_0 {
        node [fillcolor="#2c3e50", style="filled"];
        x1 [label=<
        <TABLE border="0" cellborder="0" cellspacing="0">
        <TR><TD rowspan="2" style="...">X</TD><TD style="...">1</TD></TR>
        <TR>                                  <TD style="...">1</TD></TR>
        </TABLE>>];
        x2 [label=<
        <TABLE border="0" cellborder="0" cellspacing="0">
        <TR><TD rowspan="2" style="...">X</TD><TD style="...">1</TD></TR>
        <TR>                                  <TD style="...">2</TD></TR>
        </TABLE>>];
    }

    sum [label=<∑<FONT color="yellow" point-size="10">(⎰)</FONT>>,  fillcolor="#27ae60", width=0.8, height=0.8, fixedsize=true];
    y [label=<y<sup>1</sup>>];
    
    edge [style=solid, color="#2c3e50"];
    x2 -> sum;
    x1 -> sum;

    edge [style=solid, color="#27ae60"];
    sum -> y;

    {rank=same; x1; x2;}
}

Commit messages starting with #14 whatever are awkward as # is the default comment in git rebase and friends.

git config core.commentchar ";"

fixes that for me.

For a one-time thing this works as well:

git -c core.commentChar="|" commit --amend

(escaping - Escape comment character (#) in git commit message - Stack Overflow)

Misc

• Papers
  • Comparison of Three 3D Segmentation Software Tools for Hip Surgical Planning - PMC: compares 3d slicer, Syngo, and Materialize¹
    • 
  • Comprehensive Review of 3D Segmentation Software Tools for MRI Usable for Pelvic Surgery Planning - PMC²: 12 software tools
    • really nice criteria, incl. extensibility etc.
    • 
    • 
    • TL;DR: ITK-SNAP most usable, Myrian Studio second but windows-only, 3d Slicer third but neat because easily extendable. Seg3d as also mentioned as aving very good usability
• Misc
  • https://github.com/neurolabusc/niivue-images sample nii images for evaluating nii viewers/editors

+ 3d Slicer

• Main file: 240715-1653 Notes on 3d-slicer, 240718-1530 First python 3d slicer interactions
• License:
  • About 3D Slicer — 3D Slicer documentation
  • custom license: BSD-style, broadly open source
    • no GPL/copyleft code allowed because it’d make it harder to mix slicer w/ private intellectual property
    • commercial use OK
    • 3d slicer based products — only some are listed, because one can use it and not disclose it and it’s fine
• Language: python
• extensible in python as well
  • has many cool extensions: @KitwareMedical/slicer-extensions-webapp
  • includes MONAILabel active learning extension plugin
  • a whole category for developer tools! @KitwareMedical/slicer-extensions-webapp
  • Extension Wizard — 3D Slicer documentation
    • https://extensions.slicer.org/catalog/Shape Analysis/32952/linux has extensions about stats
  • ai-assisted-annotation-client/slicer-plugin/README.md at master · NVIDIA/ai-assisted-annotation-client
• Very active community and frequent updates
• Downsides
  • J:
    • too specific for medical images
    • presets hard to customize (I agree!)
    • bad documentation (I think fixed now)
  • but: “Best of the free ones”
• Ha: https://github.com/NVIDIA/ai-assisted-annotation-client/blob/master/slicer-plugin/README.md

+ Syngo

• syngo.via OpenApps – Siemens Healthineers Deutschland
• Paid.
• Best according to ¹
• No easy way to test.

MeVisLab

• https://www.mevislab.de/
• Commercial and non-commercial version available
• Documentation:
  • Getting Started
• SDK for scripting exists
  • python QT bindings available
  • and generally feels expandable w/ python, shows python errors in the main screen for example, which is a good sign
• Official video tutorials exist, incl. for application development: MeVisLab - YouTube
• Download: a single .bin file that has to be run
• I don’t really like the website but the program itself feels nice!
• Nice pipeline visualization: and adding blocks — much less chaotic than 3d slicer (at first glance)
• overall good impression
• python scripting has a nice reference etc.

ITK-SNAP

• TODO
• Winner of ² due to its usability, does segmentation only but does it well
• available on AUR
• tutorial: TutorialSectionVolumes
• I really like it as first impression
• Has a distributed segmentation service already implemented!
  • ITK-SNAP Distributed Segmentation Services
  • 
  • ASHS Documentation - Overview sample of such a service
  • (can’t test it because pyqt6 present but not found)
• has volumes and statistics, maybe expandable
• BUT can’t find easy ways to add plugins

+ 3D Seg

• Open Source, segmentation-first
• for linux has to be compiled from source
• last meaningful commits from ~3 years ago: Commits · SCIInstitute/Seg3D, last release 2021 as well
• tried to build it, as ./build, failed because can’t find svn for
• Has detailed-ish developer documentation as videos! https://www.sci.utah.edu/cibc-software/seg3d.html
• Couldn’t build locally sadly, error in the middle of it
• Giving up

Myrian

• commercial, but non-commercial exists, and can be extended with plugins

NeuroMorph

• NeuroMorph ‐ EPFL
  • NeuroMorph | BIII
• Blender-based!

• NeuroMorph is a set of tools designed to import, analyze, and visualize mesh models in Blender. It has been developed specifically for the morphological analysis of 3D objects derived from serial electron microscopy images of brain tissue, but much of its functionality can be applied to any 3D mesh.

ilastic

• ilastik - ilastik
• integrat-able with fiji: ilastik/ilastik4ij: ImageJ plugins to run ilastik workflows and with everything else
• BioImage.IO integration as well, btw another model zoo

Fiji

• Fiji: ImageJ, with “Batteries Included”
• Legendary
• infinite plugins, very well known, downloadable as executable
• not too easy to use in my subjective opinion, menus inside menus, but…

Kitware glance

https://kitware.github.io/glance/doc/index.html

• web-based, extendable
• Kitware/glance: Kitware Glance is an open-source web application developed at Kitware for visualizing volumetric images, molecular structures, geometric objects, and point clouds. It is part of the ParaView platform and can serve as a foundation for building custom web-based visualization applications involving ITK.js and VTK.js.

Biaflows

• https://biaflows-sandbox.neubias.org/#/
• fully-online and can run models
• I don’t like the 3d viewer and I think it’s segmentation only, no easy way to generate/show stats

Why is the number of voxels different from the number of matrices? - Support - 3D Slicer Community

>>> raw = getNode('probe1_0000.nii.gz')
>>> slicer.util.arrayFromVolume(raw).shape
(180, 180, 500)
>>> 

doesn’t work for segmentations because not a volume.

Image dimensions can be seen from volume information And are identical in both segmentations and original

I found smoothing in view controllerS!

In Slice controllers there’s this arrow button that allows to set basically layers AND SMOOTHING per slice!

So everything is as expected wrt smoothing — there was none.

Zooming in slices w/ CTRL!

// ref: 240701-1752 NII MRI annotation tools

• 3D Slicer image computing platform | 3D Slicer
• DICOM seems primary format¹ but nifti is supported
• Installing from AUR

• Importing 2x .nii as directory worked as-is

• Volumes can do settings per file, incl.:

  • annotations threshold starts at 1

• Volume renderings gives 3d views?

• Annotations can be imported as annotations/segmentations through add data! Then they are parsed semantically

• One can segment N slices and it magically creates a 3d shape out of it!

• Exporting annos as nifti possible through “export” in Segmentation module ²(not Segment Editor!)

• https://www.youtube.com/watch?v=CxwxYtizdhE resampling volumes

• Diagrams

  • A Quarto tip a day - Diagrams

• This shows how to use fragments inside code/diagram segments: Fragment Layout Elements in Reveal.JS · quarto-dev/quarto-cli · Discussion #3685

• Non-quarto solutions:

  • Using code to generate graphs: GraphViz as figure when generated by R code · quarto-dev/quarto-cli · Discussion #5949
  • mapio/GraphvizAnim: A tool to create animated graph visualizations, based on graphviz.

Simplest way possible

• Multiple fragments one after the other with less and less invisible graph parts
  • style=invis: sum [label="∑", fillcolor="#27ae60", shape=circle, style=invis];¹

This makes everything invisible by default, uncommenting the lines makes the parts visible

digraph G {
    rankdir=LR;
    node [shape=circle, style=invis, fontcolor=white, fontsize=18, fillcolor="white", color="white"];
    edge [color="white", fontcolor="white"];
    graph [color="white"];
  
    
  subgraph cluster_1 {
    #label = "Inputs";
    // uncomment for visibility:
    node [fillcolor="#2c3e50", style="filled"]
    
    n0 [label=<1>];
    n1 [label=<x<SUB>1</SUB>>];
    n2 [label=<x<SUB>2</SUB>>];
    n3 [label=<x<SUB>n</SUB>>];

    { rank=same; n0; n1; n2; n3; }
  }
  
  subgraph arrows {
    // uncomment for visibility of arrows:
    edge [color="black", fontcolor="black"];
    node [style="filled", fillcolor="#27ae60"];
    
    
    n0 -> sum [label=<w<SUB>0</SUB>>];
    n1 -> sum [label=<w<SUB>1</SUB>>];
    n2 -> sum [label=<w<SUB>2</SUB>>];
    n3 -> sum [label=<w<SUB>n</SUB>>];
 
    sum [label="∑"];
  }
    
  subgraph end {
    // uncomment for visibility
    edge [color="black", fontcolor="black"];
    node [style="filled", fillcolor="#27ae60"];

    activation [label="∫", fillcolor="#f39c12", shape=circle];

    // Output node
    output [label="y", fillcolor="#8e44ad"];

    // Other edges
    sum -> activation;
    activation -> output;

   }

}

• The very best QR code generator is https://hovercode.com/
• DuckDuckGo can generate simple ones as well: qr https://www.eff.org/ at DuckDuckGo

Basics

Graphviz Online is a really nice viewer

Grouping

• You can set attributes globally or per subgraph
• edge [color="white"] makes all child edges white, unless overwritten

Labeling things

I figured out this way to label different ranks by using an invisible pseudo-graph: viewer

This is the chunk:

  subgraph labels {
    edge [fontcolor="black"];
    node [style="filled", fontcolor="black", fontsize=10];
      
    node1 [label="Inputs"];
    node2 [label="Weights"];
    node3 [label="Sum"];
    node4 [label="Activation\nfunction"];
    node5 [label="Output"];
    
    node1 -> node2 -> node3 -> node4 -> node5;
    
    {rank=same; node1;n0;n1; n2; n3;}

    
    {rank=same; node3;sum;}
  }

Note using ranks to align inputs/sum to the correct level; also the use of \n in the label.

Adding labels under nodes

• xlabel, and use HTML to make it a diff color than the main label. dot - Graphviz: Putting a Caption on a Node In Addition to a Label - Stack Overflow Graphviz: Distinct colors for xlabel and nodelabel - Stack Overflow

• To get images, rename the pptx to .zip¹ and just copy them from the archive
  • zipinfo lists everything

• ssine/pptx2md: a pptx to markdown converter does this automatically!

  • --qmd
  • Had to install deps manually
  • In LibreOffice could delete the footer and header in the master slide, giving me clean slides.
    • LibreOffice could delete header only, but not the footer — had to use MS Office for this

• // Ha: [Falk358/quarto_translator: A python project for translating quarto markdown files using the openai API](https://github.com/Falk358/quarto_translator+

  • Tested it on a small file, it actually works nicely

LaTeX

Colorful equations

How do I write LaTeX with colors in quarto presentations? · quarto-dev/quarto-cli · Discussion #4429

$$\begin{aligned}
\color{green}{\bf{Net Benefit}} = \frac{\color{green}{\bf{TP}}}{\text{N}} - \frac{\color{red}{\bf{FP}}}{\text{N}} * {\frac{{p_{t}}}{{1 - p_{t}}}}
\end{aligned}$$

$$\color{red}{w_0} + x_1*w_1 + x_2*w_2 + x_1*w_1$$  

It uses the usual names: LaTeX Color Definitions

Actually² these: MathJax-src/ts/input/tex/color/ColorConstants.ts at master · mathjax/MathJax-src

HA, it can even do usual RGB hex colors!

The useful to me are Cardinal/Carmine and Cerulean/Blue?..

Size of formulas

• Modifying the MathJax size · quarto-dev/quarto-cli · Discussion #2392 only global

• Mathjax supports things like \tiny{w_..}! (Changing mathjax’s font size - Stack Overflow)

Quarto align stuff right

Quarto: How to right justify text in PDF and HTML - Stack Overflow:

\`\`\`{=html}
<style>
.flushright {
   text-align: right;
}
</style>

::: {.flushright}

But actually,

::: {style="text-align: right;"}
$\small{E(W) = \frac{1}{n} \sum_{i=1}^{n} \mathcal{L} \left( \color{blue}{f(x^{(i)}; W)}, \color{red}{y_{true}^{(i)}} \right)}$
:::

Height and aspect ratios

Preview in a long/high browser window to see what the actual width of the presentation is. PDF export also uses the actual width

Misc

• ✕ aka MULTIPLICATION X is a really nice cross mark to use in random pictures.³
  • \times in latex
• ⮕ is a good arrow.
  • → is better (→)
  • more: HTML Unicode UTF-8

Context: in a paper, using PDF graphics is much better than e.g. PNG, because antialiasing (230628-1313 Saving plots matplotlib seaborn plotly PDF). Assume you need to crop one, and taking a PNG screenshot won’t cut it, because it would defeat the entire purpose.

LaTeX

TL;DR: in \includegraphics, trim=left bottom right top (in cm)

positioning - How can I crop included PDF documents? - TeX - LaTeX Stack Exchange:

includegraphics[clip, trim=0.5cm 11cm 0.5cm 11cm, width=1.00\textwidth]{PDFFILE.pdf}

BUT! If I’m ever in this situation, inkscape can really nicely open a PDF and export only the selected things, also as PDF.

Inkscape (much better)

1. When importing, “Replace text with closest available font”
   • e.g. OpenSans gets matched to Open Sans and it works out usually
   • the full list of fonts is shown in the import window
2. Select the part I want to crop
   1. or create a shape over it and select that shape or something
3. Export selection only as PDF; play with export settings as well if needed but for me the defaults worked this time

And either way

… test the results by downloading the PDF from overleaf and opening it locally, because antialiasing w/ imported vector pictures can be broken from within the preview window.

Used Apps/Dia - GNOME Wiki! all my life and love it, but

News! 2011-Dec-18: Version 0.97.2 has been released.

Depends on python 2.7 and is very problematic to install now. I’ll miss it.

I hear https://draw.io is a good alternative.

I’ll add a list of options here next time I need this.

(But for older dia files I’ll have to edit maybe later: it could be installed on a Windows machine and export a broken .SVG which I could then edit in Inkscape.)

Closing the window with the kitty terminal through qtile/OS means often asks you whether you really want to, as sth is running there.

Kitty has Ctrl+Shift+W which closes the terminal no questions asked.

For yay, the cache is in

$HOME/.cache/yay/

If the package is there, then: sudo pacman -U ./quarto-cli-1.4.555-1-x86_64.pkg.tar.zst

Then pin the package in /etc/pacman.conf:

# Pacman won't upgrade packages listed in IgnorePkg and members of IgnoreGroup
IgnorePkg   = quarto-cli
#IgnoreGroup =

Then yay -Syu will ignore it as well:

:: Synchronizing package databases...
 endeavouros is up to date
 core is up to date
 extra is up to date
 multilib is up to date
:: Searching AUR for updates...
 -> quarto-cli: ignoring package upgrade (1.4.555-1 => 1.5.52-1)
:: Searching databases for updates...
 there is nothing to do

Refs: How do you downgrade an AUR package? : r/archlinux

For not-AUR, there’s the downgrade command: archlinux-downgrade/downgrade: Downgrade packages in Arch Linux

References

• Refs:
  • Revealjs Options – Quarto¹
  • Advanced Reveal – Quarto
  • Revealjs – Quarto
• Previously:
  • 240424-1923 Presentations with Quarto and Reveal.js has my list of tricks
• Code
  • Quarto reveal.scss: quarto-cli/src/resources/formats/revealjs/reveal/css/reveal.scss at 303c4bc9f52ea0b0c36c5eb5dfbade9cece2b100 · quarto-dev/quarto-cli
  • Quarto Reveal footer CSS: quarto-cli/src/resources/formats/revealjs/plugins/support/footer.css at main · quarto-dev/quarto-cli

Misc

Better preview at a specific port, handy for restarting after editing CSS. Similar to quarto project frontmatter preview: port: 4444 browser: false.

quarto preview slides.qmd --port 4444 --no-browser

Supported by default

In frontmatter:

• logo is in bottom-right+
  • footer-logo-link
• footer for all slides
  • overwrite with div of class footer
• Likely relevant for me: Numbering reveajs options for dynamic bits, shift-heading-level-by, number-offset, number-section, number-depth — will touch if I need this.

Headers

• Extension: shafayetShafee/reveal-header: A Quarto filter extension that helps to add header text and header logo in all pages of RevealJs slide²
  • Has absolutely awesome documentation!

In front matter:

• header: one header text for all presentation
• title-as-header,subtitle-as-header: if true, place the presentation frontmatter’s title/subtitle as header if one not provided (overwriting the header value)
  • use-case: I same repeating text everywhere w/o specifying it every time.
• hide-from-titleSlide: all/text/logo to hide it from title slide
• sc-sb-title: if true, h1/h2 slide titles will appear in the slide header automatically when slide-level is 2 or 3

Divs with classes:

• .header: slide-specific header

• Excellent example from its docu of dynamic per-(sub-)section headers:

  • code: reveal-header/example_all.qmd at main · shafayetShafee/reveal-header
  • demo: Quarto Presentations

Left/right/center blocks of text in header

³

• If one uses section/subsection titles, they go in the left third and right third of the header, with the normal header text in the middle. This is neat to have in general, w/o the section/subsection titles.
  • sc-title, on the left, is section title
  • sb-title, on the right, is subsection title
• How do I add arbitrary text there? And what would be a good interface for it?

The right way — extension code

• I could look at the extension, maybe fork it, and find a way to put text in these divs
• Relevant code:
  • This JS populates them in each slide: reveal-header/_extensions/reveal-header/resources/js/sc_sb_title.js at main · shafayetShafee/reveal-header
  • add_header js: reveal-header/_extensions/reveal-header/resources/js/add_header.js at main · shafayetShafee/reveal-header
  • Main lua: reveal-header/_extensions/reveal-header/reveal-header.lua at main · shafayetShafee/reveal-header

Ugly CSS hack

• (Learn sass in Y Minutes)
• CSS for the header bits: reveal-header/_extensions/reveal-header/resources/css/add_header.css at main · shafayetShafee/reveal-header

Since .s[c|b]-title is present always, text added that way will be present on the title slide regardless of settings. … and — adding text to a presentation through CSS is, well, ..

.reveal-header .sc-title {
  background-color: red;

	&::before {
		content: 'sc-title header content';
  }

}

Slightly better ugly hack: main header text split in three, with two aligned l/r correspondingly.

.header-right {
  // text-align: left;
  float: right;
  background-color: pink;
  display: inline-block;
}

.header-left {
  // text-align: left;
  float: left;
  background-color: yellow;
  display: inline-block;
}

::: header 
[left]{.header-left} and not left [and right]{.header-right}
:::

Result:

Extended ugly SCSS hack

Improved the above to support both footer and headers I have a hammer and everything is a nail SCSS can do mixins let’s use them

// L/R margins of the footer — if logo is wider than this, it may overlap right footer text.
// By default, logo max-height is 2.2em, width auto based on this.
$footer-margin: 5em;

// left or right column bits
%hfcol {
  display: inline-block;
}


/* L/R columns in header */
.reveal .reveal-header .rightcol {
  @extend %hfcol;
  float: right;
}

.reveal .reveal-header .leftcol {
  @extend %hfcol;
  float: left;
}

/* L/R columns in footer */
.reveal .footer .leftcol {
  @extend %hfcol;
  float: left;
  margin-left: $footer-margin;
}

.reveal .footer .rightcol {
  @extend %hfcol;
  float: right;
  margin-right: $footer-margin;
}

Usage:

## I am a slide  with custom headers

And With content 

::: footer 
[Left footer]{.leftcol} Center footer [Right footer]{.rightcol}
:::

::: header 
[Left header]{.leftcol} Center header [Right header]{.rightcol}
:::

Frontmatter usage works only for footer, likely header doesn’t support markup.

    footer: "Center footer [right]{.rightcol} [left]{.leftcol}"  # CHANGEME

Result:

PROBLEMS:

• asymmetrical if only one of the two is present. Likely fixable, but I don’t want to force any center div.

Footers through qmd cols

This works almost perfectly, including missing values:

::: footer 

::: {.columns}
:::: {.column width="20%"}
left
::::
:::: {.column width="50%"}
Center footer
::::
:::: {.column width="20%"}
right
::::
:::

:::

It even works inside frontmatter as multiline string (not that it’s a good idea):

    footer: | 
      ::: {.columns}
      :::: {.column width="20%"}
      left
      ::::
      :::: {.column width="50%"}
      FB5 – Informatik und Sprachen: Deep Learning (MDS)
      ::::
      :::: {.column width="20%"}

      ::::
      :::

This removes the margin placing it exactly in the same place as a normal footer:

.reveal .footer p {
  margin: 0 !important;
}

(but headers don’t work)

What is a good interface?

A filter that parses frontmatter and puts things in the correct places.

Misc

• Down the front-end rabbit hole | quartoand.me

Usual:

format: 
  revealjs:
    logo: logo.png
    theme: [default, custom.scss]

Adding after the first one, so no !important needed¹:

format: 
  revealjs:
    logo: logo.png
    header-includes: |
      <link href="custom.css" rel="stylesheet">      

Inline w/o declaring classes²:

Some [red words]{style="color:#cc0000"}

or:

::: {style="font-size: 1.5em; text-align: center"}
styling an entire div
:::

• Main Quarto Reveal SCSS: quarto-cli/src/resources/formats/revealjs/reveal/css/reveal.scss at 303c4bc9f52ea0b0c36c5eb5dfbade9cece2b100 · quarto-dev/quarto-cli
• Quarto footer css: quarto-cli/src/resources/formats/revealjs/plugins/support/footer.css at main · quarto-dev/quarto-cli

Download GitHub directory: paste an URI to the directory, get .zip of that directory only. Handy for downloading only parts of datasets

• nnU-Net Revisited paper lists the following, in bold the ones it considers the best:
  • ACDC, KiTS, AMOS “most suitable for benchmarking”
  • BTCV, LiTS, BraTS

Datasets

ACDC

• Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? | IEEE Journals & Magazine | IEEE Xplore
• cardiac diagnosis
• 150 (Cardiac) MRI recordings/patients from 5 different diagnosis groups
• 3 classes: LV+RV heart cavities and myocardium
• 4D (3D+time)
• 100/50 patients train/test split
• nifti/.nii
• For each patient:
  • raw+ground truth data for two frames
  • 4d beating raw heart
  • age etc.
• links:
  • Website: ACDC Challenge
  • Dataset official download link: Human Heart Project
  • Their python code to load/save images to nifti (nii) format and compute metrics: https://www.creatis.insa-lyon.fr/Challenge/acdc/code/metrics_acdc.py
• Dataset structure
  • nifti (.nii)
  • sample: https://humanheart-project.creatis.insa-lyon.fr/database/#collection/637218c173e9f0047faa00fb/folder/6372204873e9f0047faa160b
  • folders: training/patient101/ containing
    • Info.cfg
      • metadata about the patient
    • MANDATORY_CITATION.md
    • patient101_4d.nii.gz
      • 3d of the beating heart (+time), viewable animated in the brainbrowser viewer¹
    • patient101_frame01_gt.nii.gz
      • ground truth data only for frame 01
    • patient101_frame01.nii.gz
      • raw data only for frame 01
    • patient101_frame14_gt.nii.gz
    • patient101_frame14.nii.gz

KiTS-23

• existed in 2019 2021 and 2023
  • KiTS23 | The 2023 Kidney Tumor Segmentation Challenge²
  • The main proceedings of the conference/challenge: Kidney and Kidney Tumor Segmentation: MICCAI 2023 Challenge, KiTS 2023, Held … - Google Books
  • The latest publication is from the 2021 challenge
  • // (Interesting anno startegy: professional places markers around the region, non-professional makes it into a pretty segmentation shape)
• KITS2023 dataset repo: neheller/kits23: The official repository of the 2023 Kidney Tumor Segmentation Challenge (KiTS23)
  • they use postprocessing after annotations
  • Sample: kits23/dataset/case_00194 at main · neheller/kits23
  • annotating etc. was done online and the webapp is still live: Annotate | KiTS23
    • They used the ulabel anno tool: SenteraLLC/ulabel: A browser-based tool for image annotation
• Structure
  • raw images must be separately downloaded from servers!
  • nifti/nii
  • 489 train set instances released³ — mostly similar to the files from older challenges
  • 3 classes: kidney, tumor, cyst
  • main metadata for all patients in kits23.json: kits23/dataset/kits23.json at main · neheller/kits23
  • directories are case00000-case00588
    • segmentation.nii.gz is the ground truth as used in the challenge, after postprocessing, the one we need.
    • ./instances/ has annotations — are the raw things annotated by humans.⁴
      • break brainviewer but not brainbrowser
      • [kidney|tumor|cyst]_instance-[1|2|..?]_annotation-[1|2|3].nii.gz
      • N instances — e.g. most people have two kidneys — all annotations done by 3 diff annotators, then merged into the main segmentation file.

For later.

• SenteraLLC/ulabel: A browser-based tool for image annotation is used by the KiTS23 | The 2023 Kidney Tumor Segmentation Challenge for annotation.

• TIL Arch has no cron by default, and uses systemd timers¹.
• cron - ArchWiki

sudo pacman -S cronie
sudo systemctl enable cronie.service

# many minutes were lost due to me forgetting to start it as well...
sudo systemctl start cronie.service

• I like this website to generate stuff:Crontab Generator - Generate crontab syntax
• cronie - Timed Tasks - Documentation as good as any
• the script has to be executable
• crontab -e edits your own crontab, then you can omit the username.

Cron git backup script

#!/bin/bash

# https://stackoverflow.com/posts/1482133/
# get the directory where this file is located
DIRNAME="$( dirname -- "$( readlink -f -- "$0"; )"; )"

cd $DIRNAME &&
git add -A &&
git commit -m "Automatic backup at `date`" &&
git push origin master &&
echo "Done"

# and this is the crontab
# odd hours:
# * 1-23/2 * * *  /bin/bash $HOME/this-script-location.sh > /tmp/cronlog

EDIT: sometimes if git crashes an index file stays and then nothing runs — so the cronjob must be somehow monitored manually, todo.

TL;DR: fish easy version below works, but needs quotes when expression is complex: cc 2+2 but cc 'floor(2.3)'.

I’m continuing to move my useful snippets from zsh to fish (240620-2109 Fish shell bits), and the most challenging one was the CLI python calculator I really love and depend on, since it contained arguments with parentheses (which are fish expressions as well).

Basically: cc WHATEVER runs WHATEVER inside python, can do both easy math a la 2+2 and more casual statistics-y mean([2,33,28]).

Before in zsh this was the magic function:

cc() python3 -c "from math import *; from statistics import *; print($*);"
alias cc='noglob cc'

Fish, easy version:

function cc
  command python3 -c "from math import *; from statistics import *; print($argv);"
end

Works for easy cc 2+2 bits, but as soon as functions and therefore parentheses get involved (cc floor(2.3)) it starts to error out.

[I] sh@nebra~/t $ cc mean([2,4])
fish: Unknown command: '[2,4]'
in command substitution
fish: Unknown command
cc mean([2,4])
       ^~~~~~^
[I] sh@nebra~/t $ cc mean\([2,4]\)

>>> mean([2,4])
3
[I] sh@nebra~/t $

(But I REALLY don’t want to do cc mean\([2, 3]\))

In the zsh snippet, noglob meant basically “take this literally w/o expanding anything”, and it passed everything as-is to python, and this is what fails in my fish solution.

Noglob in fish is fun:

• The fish language — fish-shell 3.7.0 documentation on escaping characters
• Implement the noglob modifier · Issue #3504 · fish-shell/fish-shell:

  If you wish to use arguments that may be expanded somehow literally, quote them. echo ‘’ and echo “” both will print the literal.

• The fish language on quotes:
  • single quotes = no expansion of any kind
    • \' for literals inside single
  • double quotes = variable exp. ($TERM) & command substitution ($(command))
    • \" for literal "s inside double
  • within each other, no special meaning
  • Let’s test:
    • echo (ls) = ls output, one line
    • echo "$(ls)" = ls output, multiline
    • echo '(ls)' = (ls)
    • echo "(ls)" = "(ls)"

THEN

• command python3 -c "from math import *; from statistics import *; print($argv);"

  • cc ceil\(2\) +
  • cc ceil(2) -

• `command python3 -c “from math import *; from statistics import *; print(’$argv’);”

  • literally prints the passed thing w/o python eval, w/ same rules

• OK can I do a variable then?

  set pyc $argv
  echo $pyc
  command python3 -c "from math import *; from statistics import *; print($pyc);"

nope.

Bruteforcing the solution

(and learning to use fish loops mainly, of course there are better ways to do this.)

# list of simple, brackets, and parentheses + no, single, double quotes 
# no space between nums in brackets, python interpreter would add them. [2,3] — literal, [2, 3] — parsed by python
set cmds \
'2+2' \
'\'2+2\'' \
'"2+2"' \
'[2,3]' \
'\'[2,3]\'' \
'"[2,3]"' \
'floor(2.3)' \
'\'floor(2.3)\'' \
'"floor(2.3)"' 

function tcc
  set pyc $argv
  # command python3 -c "from math import *; from statistics import *; print" '(' "$pyc" ');'
  # command python3 -c "from math import *; from statistics import *; print($pyc);"
  command python3 -c "from math import *; from statistics import *; print($pyc);"
end


# loop through all test cases to see sth that works for all
for i in $cmds
  echo $i:
  echo "   $(tcc $i)"
end

At the end, no additional literal quotes + initial command didn’t error out, and we came full circle:

set cmds \
'2+2' \
'[2,3]' \
'floor(2.3)' 

# winner command!
function tcc
  command python3 -c "from math import *; from statistics import *; print($argv);"
end

[I] sh@nebra~/t $ ./test_cc.sh
2+2:
   4
[2,3]:
   [2, 3]
floor(2.3):
   2

• Double quotes in the python command mean only $pyc gets expanded
• $pyc in the working versions have no hard-coded quotes
• in CLI tcc floor(2.3) still fails — because like that it’s a command, not a string. In the file it was inside single quotes, as a string. So I can do this in the CLI as well.

So simple and logical at the end.

Final solution

function cc
  echo ">>> $argv"
  command python3 -c "from math import *; from statistics import *; print($argv);"
end

When using, quotes are needed only for complex bits (parentheses, * etc.).

[I] sh@nebra~/t $ cc 2+2
>>> 2+2
4

[I] sh@nebra~/t $ cc [2,3,4]
>>> [2,3,4]
[2, 3, 4]

# no quotes
[I] sh@nebra~/t $ cc mean([2,3,4])
fish: Unknown command: '[2,3,4]'
in command substitution
fish: Unknown command
cc mean([2,3,4])
       ^~~~~~~~^

# with quotes
[I] sh@nebra~/t $ cc 'mean([2,3,4])'
>>> mean([2,3,4])
3

So I literally had to follow the advice from the first link I found and used single quotes in my initial command:

If you wish to use arguments that may be expanded somehow literally, quote them. echo ‘’ and echo “” both will print the literal.

Still, I learned a lot about fish in the process and honestly am loving it.

TL;DR use Chromium

PDF, PS and DjVu - ArchWiki has a table, but it lies, in my tests:

• zathura explicitly no support
• evince didn’t work
• gnome document viewer didn’t work

And for the Nth time, I end up remembering about Chrome/Chromium PDF viewer, that does this reliably.

Run and disown

In my old zsh config I had this:

function dos() {
    # run_disowned and silenced
    nohup "$@" >/dev/null 2>&1 & disown
}

Emulating my old dos command in fish:

• disown - remove a process from the list of jobs — fish-shell 3.7.0 documentation:
  • firefox &; disown starts and disowns ffx.
• terminal - How do I get fish to swallow? or at least to detach itself from a program - Stack Overflow

Both together give this solution:

function dos
  echo "disowning $argv"
  command $argv  >/dev/null 2>&1 &
  disown
end

Shell notation for $(cmd)

shell - Fish equivalent of bash $(command) notation - Stack Overflow: - bash: $(command) - fish: (command)

which command

type - locate a command and describe its type — fish-shell 3.7.0 documentation: type commandname.

[I] sh@nebra~/me/me-qs $ type cc
cc is a function with definition
# Defined in /home/sh/.config/fish/config.fish @ line 184
function cc
  echo ">>> $argv"
  command python3 -c "from math import *; from statistics import *; print($argv);"
end

When doing a multilingual quarto website using profiles (240619-1425 Quarto multilanguage website), quarto preview/render --profile de allows previewing only one language, and the menu links (/de/xxx) break.

Solution to preview EVERYTHING, including menu links logic:

# Todo break on erorr
quarto render --profile=ua
quarto render --profile=en
quarto render --profile=de

And then serve the _site directory locally through a simple webserver, e.g. Python SimpleHTTPServer - Python HTTP Server | DigitalOcean, and see the result on http://localhost:9000:

python3 -m http.server -d _site 9000

TL;DR –no-clean is dangerous

quarto render --no-clean ... (or an interrupted render?) created many .html.md files in the same dirs as their .qmd/.md sources:

papers/11-bank2011using/index.md               papers/23-hanig2023nlp/index.md
papers/11-hanig2011benefits/index.html.md      papers/23-tumler2023virtual/index.html.md
papers/11-hanig2011benefits/index.md           papers/23-tumler2023virtual/index.md
papers/11-hanig2011knowledge/index.html.md     papers/24-hamotskyi2024fincorpus/index.html.md
papers/

Then the custom listing for */*.md went crazy because the html.md files didn’t have the needed fields. (also .jsons/.html etc.)

Quarto has no quarto clean but one can just re-render everything without --no-clean

Fish globs

To find all these files arbitrarily many levels deep:

ls **/*.html.md

ERROR: TypeError: title.trim is not a function quarto

happens for me when in front-matter I do

---
# title: "Publications and Awards"
title: {\{< var test >}}

instead of QUOTED

---
# title: "Publications and Awards"
title: "{\{< var test >}}"

ALSO, interestingly, when I save the wrong version while previewing the error is better:

ERROR: Validation of YAML front matter failed.
ERROR: In file publications.qmd
(line 3, columns 8--24) Field "title" has value {\{< var test >}}, which must insteadbe a string
2: # title: "Publications and Awards"
3: title: {\{< var test >}}
         ~~~~~~~~~~~~~~~~~
4: css: ./posts_publications/pub_style.css
✖ The value {\{< var test >}} is of type object.
ℹ The error happened in location title.

ERROR: Render failed due to invalid YAML.

So: quarto errors are more detailed when previewing instead of when compiling from zero? Interesting. Okay.

• No native support

• R package exists, but I don’t feel like digging into R at all: Renders a Multilingual Quarto Book • babelquarto

• The other approaches I found are all based on project profiles and conditional output

  • oooo12 - Multi-language Blog with Quarto - Guide
  • Mario Angst - A multi-language (German/ English) Quarto website
    • only difference is that it’s /de/ /en/ instead of ENG being /en/
    • nice and more detailed about interesting corner cases

• Document Language – Quarto¹ for setting one language in the page and doing per-language changes to the template texts

  • quarto-cli/src/resources/language at main · quarto-dev/quarto-cli
  • quarto-cli/src/resources/language/_language.yml at main · quarto-dev/quarto-cli

• Conditional Content – Quarto

• Project Profiles – Quarto

Config files

_quarto-profilename.yml ONLY, the rest won’t get parsed

profile:
  default: en
  # mutually exclusive group: you can do only one
  # (otherwise `--profile one,two` does multiple)
  group: 
    - [en, de, uk]

Page content

# `unless-profile` exists as well
::: {.content-visible when-profile="en"}
This content will only appear in the advanced version.
:::

Links

Links are going to be interesting!

Currently /de is German, / is English.

Main home page is .. from DE lang, or /de from EN.

Menu items:

• ENG as-is. (`href: whatever.qmd)
• DEU: href: ../de/lehre.html — note the HTML bit!

But when previewing DEU, all of these pages are at / — ergo menu items don’t work, as they lead to a non-existing ../de/...

ALSO: marioangst.de shows nicely how one can link to other languages from the menu!

- icon: book
href: publications.qmd
text: Publikationen
- href: ../en/blog
text: Blog (englisch)

Site language

Website Options – Quarto tells me I can do this in each _quarto-de.yml etc. profile:

format:
  html:
    lang: de
	#lang: ua
	#lang: en

This changes the interface to follow the corresponding quarto-cli/src/resources/language/_language.yml at main · quarto-dev/quarto-cli

Unsolved

How do I change front matter (e.g. title)?

Not dealt with in any of the approaches: quarto’s native Document Language¹ thing

So: - How do I do different post titles per language? - How do I change site language, so _languages.yml, conditionally?

• Project Basics – Quarto discusses the various approaches to metadata

  • And I can conditionally include stuff

• … I could literally do a bash script that puts a _metadata.yaml, builds with a proflie, then removes that file. Oh this would be painful

• Skimming Website Options – Quarto doesn’t really help

  • except that I can set html format lang: de from within profiles! NICE

Do variables magic

• title gets taken from variable title[currnet-profile-name] or something?
• _variables.yml works for var shortcodes (240619-1845 Quarto error title.trim() is not a function), and shortcodes can do metadata too

# works
title-en: "Publications and Awards"
title: "{\{< meta title-en >}}"

If only I could do per-language attributes as shown in the docu²:

language:
  en:
    title-block-published: "Updated"
  fr:
    title-block-published: "Mis à jour"

It would be so cool if one could overwrite the other variables

language:
  de: 
    title: german post title

The above would nicely get a language from the profile _quarto-lang.yml and automatically change the things. Can I do this for titles and front-matter?

• I’m not alone:
  • Is there a way to insert variables in other shortcodes with Quarto? - Stack Overflow

I can get the current profile from the env variable

profile: {\{< env QUARTO_PROFILE >}}

If I could just

title: vars['titles']['postname'][QUARTO_PROFILE]

• Asked this on Github: How do I do conditional YAML frontmatter, e.g. based on profile? · quarto-dev/quarto-cli · Discussion #10064
  • Mea culpa, discussed already: Conditional metada for different profiles on a website · Issue #4516 · quarto-dev/quarto-cli Conditional metada for different profiles on a website · quarto-dev/quarto-cli · Discussion #4455 no idea how I missed this.

Use scripts

• Project Scripts – Quarto
  • A python script that sets title based on QUARTO_PROFILE

Quarto lua filters

OK let’s do this. No choice.

Learn Lua in Y Minutes

First³ attempt to write anything in lua:

function Meta(m)
  local profiles = quarto.project.profile
  local profile = profiles[1]
  if profile then
    print("Profile: " .. profile)
    m.active_profile = profile
  end

  if profile and m.titles and m.titles[profile] then
    cleantitle = pandoc.utils.stringify(m.titles[profile])
    oldtitle = pandoc.utils.stringify(m.title)
    m.title = cleantitle
    print("Profile:" .. profile)
    print("Old title:" .. oldtitle)
    print("New title:" .. cleantitle)
  end

  return m
end

I’d need to make it more robust:

• multiple profiles? Not now
• No titles set in titles — use the default one

So:

• Always require a title
• Optionally add array of titles, indexed by language=profile name
• If present use one of these.

function Meta(m)
  local profiles = quarto.project.profile
  if not profiles then
    -- TODO: missing YAML key? Empty YAML key?..
    -- TODO even more later: filter multiple profiles to use the language one
    return m
  end

  local profile = profiles[1]
  -- If we have a named profile, save it, otherwise return
  if profile then
    print("Profile: " .. profile)
    m.active_profile = profile
  else
    return m
  end

  if m.titles then
    local titles = m.titles
    if titles[profile] then
      newtitle = pandoc.utils.stringify(titles[profile])
      oldtitle = pandoc.utils.stringify(m.title)
      -- log both if they differ
      if newtitle ~= oldtitle then
        m.title = newtitle
        -- print("Old title:" .. oldtitle)
        -- print("New title:" .. newtitle)
        print(oldtitle .. " => " .. newtitle)
      end
    else
      print("Title for profile " .. profile .. " not found among ")
      for lang, title in pairs(titles) do -- Table iteration.
        print("    " .. lang .. ": " .. pandoc.utils.stringify(title))
      end
    end
  end

  return m
end

Main problems:

• listing pages use the old title anyway
• supports only title, not e.g. description (used, again, in listings)
  • and side menus!

All from javascript - How can I comment the EJS code (JS node) without getting an error - Stack Overflow:

// Neat multiline comment thing
<%if(false) {%>  
  <!-- single row of inline icons for pdf. etc instead of buttons -->
<%} %>

// hard to grep for and no syntax highlight, so maybea adding COMMENT works as my bad idea
<%if(false) {%>  
  <!-- COMMENT 
	single row of inline icons for pdf. etc instead of buttons 
  -->

// Documentation says: 
<%# comment %> 


// Not documentation, multiline comment:
<%/* comment */%> 

I had issues putting HTML code w/ EJS snippets in the latter one, so iffalse it is. For nested things, SO suggests these (both bad imo):

<!--label for="<%#= user.id %>" style="background-color: <%#= user.color %>;"-->
<!--label for= <%#=`${user.id}` %> style= <%#=`background-color: ${user.color};`%> -->

Given: quarto website page with publications. Previously touched upon in the messy 240605-2055 Quarto website creation notes.

Anchor links in (quarto) markdown

This works:

[UNLP paper](publications.qmd#hamotskyi2024unlp)

Anchor targets

• Only correct solution: ¹ <a name="title"></a>
  • (markdown - How to link to a named anchor in Multimarkdown? - Stack Overflow says to use the name=, not id=, attribute, but this doesn’t work for me in quarto.)

Template

// Get anchor id somehow from paper path
<% let y= item.path.split('/'); y.pop(); let dirname = y.pop(); let citation_key = dirname.split('-').pop() %>

// Overwrite with paper front-matter if there's one
<% if (item.citation_key) { %> 
	<% citation_key = item.citation_key %>
<% } %>       

// Add to paper listing thing 
<a id="<%= citation_key %>"></a>

Old way with systemd

/etc/systemd/system/user-suspend@.service:

[Unit]
Description=Lock the screen
Before=sleep.target

[Service]
User=%I
Type=forking
Environment=DISPLAY=:0
ExecStart=/usr/bin/xlock -usefirst -echokeys -description -modelist swarm,starfish,mandelbrot,polyominoes,fadeplot,matrix,lisa,life3d,life1d,kumppa,grav,flow


[Install]
WantedBy=sleep.target 

To enable¹: sudo systemctl enable user-suspend@myusername.service

Arch wiki (Session lock - ArchWiki) omits @myusername which leads to this error:

Failed to enable unit: Destination unit sleep.target is a non-template unit.

Also: xlock (xlockmore) is neat, here’s a list of modes: XlockMore modes

(Also: XScreenSaver versus XLock)

Offtopic but cool: Cool, but obscure X11 tools

New way with xss-lock

Added this to qtile autostart:

xss-lock -- xlock -usefirst -echokeys -modelist qix,lisa & 

Also

Auto-lock after 300 seconds:

xset s on xset s 300

Added ddg’s backslash-feeling-lucky to qb search engines. Encoded the backslash as URI, it worked!

https://duckduckgo.com/?q=%5C{}

Full list:

c.url.searchengines = {
        'DEFAULT': 'https://search.brave.com/search?q={}',
        'b': 'https://search.brave.com/search?q={}',
        'g': 'https://google.com/search?q={}', 
        's': 'https://scholar.google.de/scholar?hl=de&as_sdt=0%2C5&q={}&btnG=', 
        'ddg': 'https://duckduckgo.com/?q={}', 
        'l': 'https://duckduckgo.com/?q=%5C{}', 
        'c': 'http://dict.cc/?s={}', 
        'y': 'https://youtube.com/results?search_query={}',
        'd': 'https://en.wiktionary.org/wiki/Special:Search?search={}',
        'w': 'https://en.wikipedia.org/wiki/Special:Search?search={}',
        'wa': 'http://wolframalpha.com/input?i={}', 
}

maim is supposed to be the “better scrot”¹

# screenshot and put into clipboard
 maim -s | xclip -selection clipboard -t image/png -i

In qtile you can’t do that, because | is a shell construct².

Solution: do it in a shell:

CommandSet(commands={
	#...
	"S/clipboard": "bash -c \"maim -s | xclip -selection clipboard -t image/png -i\"",

A minimal citation style(for grant proposals) – anton.cromba.ch

Obyde needs 3.8 and fails otherwise, new OS maybe time for new ways to convert. There are many actually. Some active mantained and expandable.

For later:

• devidw/obsidian-to-hugo: Process Obsidian notes to publish them with Hugo. Supports transformation of Obsidian wiki links into Hugo shortcodes for internal linking. looks especially nice.
• Publishing Obsidian vault with Hugo - Sagar Behere lists all the other ways and is really detailed
• (Also on hugo A Hugo Survival Guide is a neat thing I’ll read sometime)

So

obsidian-to-hugo doesn’t support assets/images :( Leaving only ukautz/obsidian-meets-hugo: Command line tool to export Obsidian Vault into Hugo published website for me.

• preserves Obsidian directory structure — nice
• not recursive by default
• doesn’t create _index.md files, and converts existing ones in Obsidian to -index.md
  • pchr8/obsidian-meets-hugo: Command line tool to export Obsidian Vault into Hugo published website forked and did my first go programming to fix this
• doesn’t support folders, but one can filter by tags — good that I used both since the beginning!
  • for multiple tags a “list” is possible — and apparently that’s -i tag1 -i tag2 -i tag3¹

Current CLI:

go run cmds/omh/main.go --obsidian-root=../public_obs/ -R --hugo-root=../dtb/ --sub-path= -i=uni -i=zc/it -i=zc/rl

Onwards

• 3 refs not found
  • I don’t understand why hugo says “ref … page not found” - support - HUGO:

    Is linksphoto.md unpublished (draft, expired, or future)? Or, to put it another way, what happens when you run hugo server -DEF?

  • fixed for me! hardcoded hugo-format refs in obsidian broke because now different names — converted to real obsidian links and this fixed the remaining ones
• cyrillic names now unsupported?
  • 220407-2246 Чебуреки etc.
  • damn.
  • It’s the same

    var insane = regexp.MustCompile(`[^a-zA-Z0-9\-]`)
    func Sanitize(in string) string {
    	return insane.ReplaceAllString(in, "")
    }
    

  • w/ chatGPT, changed regex to [^a-zA-Z0-9\-\p{Cyrillic}] — now it does upper+lowercase cyrillics — so now it’s 220407-2246-Чебуреки.md in the md filename, but the URI has it lowercased.
  • Relevant: disablePathToLower in config² — not changing because cool URIs don’t change and this was the default for years on this website
• Images are broken
  • ![2024-05-13-182935_1304x442_scrot.png](//assets/2024-05-13-182935-1304-x-442-scrot.png)
  • … //assets alrighty…
  • Docu: Static files | Hugo

    • By default, the static/ directory in the site project is used for all static files (e.g. stylesheets, JavaScript, images). The static files are served on the site root path (eg. if you have the file static/image.png you can access it using http://{server-url}/image.png, to include it in a document you can use ![Example image](/image.png)).

    • you can have multiple such directories
  • Ah — maybe it’ll work when uploaded to my website, where /xxx will refer to the website and not my local install
  • If I manually fix //assets/.. to /assets (one slash) then it shows up nicely locally
  • In omh.go this happens: return fmt.Sprintf("[%s](/%s/%s)", title, c.SubPath, target)
  • AH it’s because of my empty subpath directory argument — if I pass something then everything works. Oh GodDAMN it.
  • OK this fixes it. And I hope creates no more problems.

    if c.SubPath == "" {
        return fmt.Sprintf("[%s](%s/%s)", title, c.SubPath, target)
      } else {
    return fmt.Sprintf("[%s](/%s/%s)", title, c.SubPath, target)
    

  } ```
• Debugging a notes called _index I realize that it takes Hugo frontmatter title from note title, which in turn is the filename, NOT the obsidian file frontmatter title :(
  • problem because my layouts rely on a magic constant in some directories…
  • I hope it’s my last fix.

  // Keep title in Obsidian front-matter as note title if it's there (a la obyde), 
  // otherwise use Obsidian filename for this (standard behaviour). 
  oldTitle := hugo["title"]
  if oldTitle==nil {
    log.Warn("No title in front-matter, using filename in ", note.Title)
    // must have title
    hugo["title"] = note.Title
  } else {
    log.Warn("Using frontmatter title for ", oldTitle)
  }

• Quarto – Document Language is related but different.

• R package for this, but R: ropensci-review-tools/babelquarto: Renders a Multilingual Quarto Project (Book or Website)

• Mario Angst - A multi-language (German/ English) Quarto website

  • Profiles + visible-when — all langs in one file, looks kinda ugly but why not…
  • Quarto – Project Profiles

• oooo12 - Multi-language Blog with Quarto - Guide profiles as well.

• Approach for now — write them in separate files, and optionally at some point include them in the visible-when option?..

quarto create project 

Listing pages

• Quarto – Document Listings
  • Quarto – Creating a Blog
• Dates are awkward: Quarto – Quarto Dates and Date Formatting

---
title: "Blog"
listing:
- id: test-l1
  contents: "blog_posts/*"
  sort: "date desc"
  type: table
  categories: true
- id: test-l2
  contents: "blog_posts/*"
  sort: "date desc"
  type: default
  categories: true
- id: test-l3
  contents: "blog_posts/*"
  sort: "date desc"
  type: grid
  categories: true
---

This will be a test listing page.


## Table listing
::: {#test-l1}
:::


## Default listing
::: {#test-l2}
:::


## Grid listing
::: {#test-l3}
:::

• Configs
  • each directory can have it’s own _metadata.yml with configs that will be applied to all files in that directory

Publications

To get something like Drew Dimmery - Research or our old wowchemy thingy some magic will be needed.

Doing

---
title: "Publications and Awards"
bibliography: "./publications/papers.bib"
nocite: |
  @*
---

results in a list in a certain CSL format, which is limited — no ways to link videos/slides/… etc.

So likely it’ll be yet another listings view, or how Drew Dimmery - Quarto for an Academic Website did it — papers to YAML with ALL the metadata, then python script (inside quarto qmds, first nice case I see for this!) to convert it into the on-screen form.

And if code — then maybe it’s a conveter package from wowchemy yaml thingy?

• Quarto – Custom Listings together with “listing from yaml” may help?.. - Supporting category like feature for listing authors (e.g. filter by author like categories) · Issue #6246 · quarto-dev/quarto-cli TL;DR complex tags work
  • EJS – Embedded JavaScript templates is used for templating — looks kinda similar to Hugo
  • Meghan Hall describes this and links to Quarto’s own listing templates: quarto-cli/src/resources/projects/website/listing/listing-table.ejs.md at main · quarto-dev/quarto-cli
  • (Quarto – Article Templates for the general thing)

OK, then:

• Concatenate all wowchemy publication files into one large yaml (one-time python thing?)
• do EJS template for it

(Alternatively — just use the dirs as-is and do no yaml)

Onwards

• Albert Rapp - The ultimate guide to starting a Quarto blog

  • cool tutorial about the basics, including:
    • many ways to use listings to create blogs, archive pages, etc. + per-directory options
    • layouts to create cool pages e.g. contacts
    • include-after-body footers
    • styling, incl. scss rules
    • page-layouts and complex reactive grids

• Quarto – Article Layout is my friend — columns, margins, overflows etc.

• Quarto – Page Layout

• Quarto – HTML Options

• Code/Other links text can be changed here: quarto-cli/src/resources/language/_language.yml at main · quarto-dev/quarto-cli

• Quarto glob syntax can do a lot: Quarto – Quarto Glob Syntax

• cool pic sources:

  • LoremFlickr: free placeholder images

• sample of including a style in the qmd: quarto-web/docs/gallery/index.qmd at main · quarto-dev/quarto-web

Creating a publications view

• This convets bibtex into directory+md: GetRD/academic-file-converter: 📚 Import Bibtex publications and Jupyter Notebook blog posts into your Markdown website or book. 将Bibtex转换为Markdown网站

• Hugo Blox template? hugo-blox-builder/modules/blox-bootstrap/layouts/publication/single.html at main · HugoBlox/hugo-blox-builder

  • all fields: hugo-blox-builder/modules/blox-bootstrap/archetypes/publication/index.md at main · HugoBlox/hugo-blox-builder

• Gallery example: https://github.com/quarto-dev/quarto-web/blob/main/docs/gallery/gallery.ejs

  • Ex. includes using quarto syntax w/ ::: in a template: quarto-web/ejs/links.ejs at main · quarto-dev/quarto-web

• Would be cool to have the format consistent with the existing quarto infra: quarto-web/docs/journals/authors.qmd at main · quarto-dev/quarto-web

• EJS

  • EJS – Embedded JavaScript templates
  • EJS — Embedded javascript tutorial | by Simuratli | May, 2024 | Level Up Coding:
  • Introduction to EJS: A Guide to Building Dynamic Web Applications - DEV Community

	<% for (let i = 0; i < item['authors'].length; i++) { %>
<%= item['authors'][i] %>,
    <% } %>

• Problem: full HTML templates don’t accept markdown bits: Markdown not parsed in listings with custom EJS · Issue #8756 · quarto-dev/quarto-cli

Changes in the paper mds

• Remove markdown from all existing paper md, HTML-only
• Remove “image” key
• date is publishing date of the paper, not of its page — publishDate doesn’t exist
• publicationType: maybe at some point change the int representation into str, as per latest hugo blocks behaviour
• doi: no URI
• publication: no In *journal*, just journal

This and only this will be supported:

title: 'Title'
authors:
  - TODO
  - TODO
date: '2010-10-20T00:00:00Z'
doi: 

# Publication name and optional abbreviated publication name.
publication: 'Proceedings of the World Congress on Engineering and Computer Science. Vol. 1'
publication_short: 'WCeCS 2010'

abstract: 'Long abstract'
links:
  - name: TODO Anthology
    url: https://aclanthology.org/L14-1240

url_pdf:
slides:
video:

tags:
  - paper-tag

EDIT: more fields here: hugo-blox-builder/modules/blox-bootstrap/archetypes/publication/index.md at main · HugoBlox/hugo-blox-builder

url_pdf:
url_code:
url_dataset:
url_poster:
url_source:
url_project:
url_slides:
url_video:

Process

Parsing date year

Datetime formatting / customization in ejs - Stack Overflow describes ways to do things with dates in EJS/JS

<%= new Date().getFullYear();%>

OK so I can use JS?

// Works
<%= new Date(item.date).getFullYear() %>

Iconify Icons

I can’t seem to use shortcodes inside html EJS (same as markdown problem I guess?)

But I can use the CSS (and ofc just download the PNG files)

Accessing file path to find its Bibtex

.. in a file inside same dir as paper markdown.

• Problem: no access to filename being rendered!

• item.filename is the name, not path. I can’t do “link to file in the same directory as the one being listed”

• Find the name of the current file being rendered in Quarto - General - Posit Community

• At some point you could use shortcodes in frontmatter: Variables in categories (in frontmatter) do not parse properly when categories is set to true in listing · Issue #5578 · quarto-dev/quarto-cli

  • metadata is the one in the listing page, not the page being listed :(

• [FR] New Lua utility function to access qmd input filename · Issue #2249 · quarto-dev/quarto-cli

  • mcanouil/quarto-lua-env: lua-env is an extension for Quarto to provide access to LUA objects as metadata.
  • extension to get access to some vars
  • works for not-frontmatter

• Just realized that for listings item.path (=location of page) is just what I need — I just need to change the last element

  • Split Path String - DEV Community for js path operations

Most horrible thing I’ve ever written but seems to work:

<%= item.path %><br>              
<% let x= item.path.split('/') %> 
<% x.pop() %>                     
<%- x.join('/') %>                
<%- x.join('/') %>/cite.bib       

// ---

<% let x= item.path.split('/'); x.pop(); let biburi =  x.join('/')+'/cite.bib' %>
<a href="<%- biburi %>">
	<%= biburi %>
</a>

(I should just do a lua filter or something at this point)

Anchors

Idea: link from elsewhere directly to the paper in papers

• Text fragments
  • not supported in firefox
  • could write a trivial style and use quarto’s mechanisms for citations but that doesn’t matter because not widely supported
• anchors
  • markdown - How to link to a named anchor in Multimarkdown? - Stack Overflow
  • completed with anchors, taken from dirname and optionally overwritten by a paper’s front-matter

Final system: described in 240618-1448 Quarto publications page and adding anchors

Wanted to do Manjaro, after googling found out it has a very bad reputation (arindas/manjarno: Reasons for which I don’t use Manjaro anymore) — I’ll go with EndeavourOS. OpenSUSE Tumbleweed will be my next choice if this fails.

Strategy:

• /opt will have executable programs
  • TG, hugo(?), pycharm, kitty?..
  • qtile, qutebrowser
• home encrypted, but separate swap+etc. partitions of size of ram
  • or not, since encrypted home/swap/… and hibernation are hard — so only encryption
• FS: BTRFS
  • …because snappshotting for if one randomly rms /etc¹².
    • SysadminGuide - btrfs Wiki
    • I like this: Btrfs - Manjaro
    • Reasons against exist³.
      • df will incorrectly report space usage
      • no native encryption support
      • complexity
  • F2FS is the fastest for SSDs but can lose data if battery dies
• Dotfiles
  • radically simplify everything, no need to source global ones and /home/me etc. — I’ll just use the same user for everything

OK, EndeavourOS+btfrs it is.

• Post-install steps
  • Average User’s To Do List after doing a fresh install of Endeavour OS with KDE Plasma : r/EndeavourOS
  • https://forum.endeavouros.com/t/coming-from-manjaro-to-endeavouros-installation-advice-for-btrfs-snapper-btrfs-assistant/34003/2 setting up snapshots

• Not supported out of the box:
  • https://inkscape.org/forums/questions/bulletpoints-and-more-advanced-text-controls/
• https://alpha.inkscape.org/vectors/www.inkscapeforum.com/viewtopic0f39.html?t=9647:

  • I usually clone a circle and distribute it evenly next to the text object

  • <C-u-2022> adds a bullet point symbol

https://www.kaggle.com/code/datark1/what-are-dcm-and-nii-files-and-how-to-read-them

• NII files are typical for MRI data

• This library can open them: https://nipy.org/nibabel/gettingstarted.html

  • Read and write access to common neuroimaging file formats, including: ANALYZE (plain, SPM99, SPM2 and later), GIFTI, NIfTI1, NIfTI2, CIFTI-2, MINC1, MINC2, AFNI BRIK/HEAD, ECAT and Philips PAR/REC. In addition, NiBabel also supports FreeSurfer’s MGH, geometry, annotation and morphometry files, and provides some limited support for DICOM.

• Cool viewers exist

  • online
    • https://socr.umich.edu/HTML5/BrainViewer/
      • for annotated files, 3d opacity+threshold help seeing the annotated areas VS raw image
      • drop multiple files (e.g. raw + ground truth) to have them as multiple layers
    • https://brainbrowser.cbrain.mcgill.ca/volume-viewer
      • can do 4d (3d+time) viewing! E.g. beating heart from ACDC dataset
    • https://www.fmrib.ox.ac.uk/ukbiobank/group_means/index.html may or may not be papaya
    • https://niivue.github.io/niivue-ui/ neat w/ probe1.nii.gz
    • https://viewer.imaging.datacommons.cancer.gov/viewer/1.3.6.1.4.1.14519.5.2.1.6279.6001.224985459390356936417021464571?seriesInstanceUID=1.2.276.0.7230010.3.1.3.0.57823.1553343864.578877,1.3.6.1.4.1.14519.5.2.1.6279.6001.273525289046256012743471155680 a cool viewerKKJJjjkk

• list of others: https://docs.facebase.org/docs/nifti-files/

• https://github.com/niivue/niivue even better list of others

• Other

  • Maternal Brain Project - OpenNeuro OpenNeuro has many datasets

Quarto’s roughnotation works either in speaker view or in the presentation, separately from each other.

Very brittle, but:

• jitsi share my presentation window, “show me what I’m sharing” and then right click picture-in-picture
• drag that picture over the presentation in speaker view :)

.. yeah.

A particularly complex file after a crash became cursed: two boxes would export to PNG fine, but not to PDF.

After closing and opening these two boxes became just as in the PDF export.

Solution: delete the problematic elements from the PDF and recreate them.

So I learned that poster videos are a thing, 10 years ago I’d have used Prezi but not now

And TIL inkscape has neat keybindings for zooming.

So.

• Inkscape keyboard and mouse reference | Inkscape

• View -> Zoom has a list as well

  • I should have looked at it earlier — it has neat things e.g. X-ray etc.:

• 3 zooms in to the selected element

• 1-6 are all zooming things (from the docu):

  • 

• 3-Layout-extraction-1 is a 6min description I have not watched but could be nice.

Context: 240423-1912 Better Posters notes

Grids

• Two — once in document properties, and there seems to be a tool for this as well.
• units are important — doing math in mm and then creating a grid in px/pc/pt/… may create not-obvious errors
• Snapping to an invisible grid still works — neat for a sub-grid that would create too much garbage but is needed (e.g. margins in a column)

Selecting

• You can select items by color/stroke/type/… in Edit -> Select…
  • E.g. select all texts, all blue rectangles etc.

Resizing boxes

You can disable scaling the stroke size together with the box in the upper-right toolbar! (The same one where locking aspect ratios is)

Text

• You can draw a rectangle and then add text to it — use the text tool to draw this rectangle.
• Text -> Flow into frames can do what it says on the label:
• If it looks weird or different from other text but font and size and the rest match, the text likely has a stroke.

Tracking invisible items

For things into which text “flows” etc. — if you have a white background making them white works for keeping them selectable when needed. (And removing the background makes them visible).

Smile for the screenshot

Damn I love doing random vector stuff.

Basics

• Quarto – Revealjs

• Quarto – Advanced Reveal

• Oh it has another page with a clean reference! Quarto – Revealjs Options

• Default presentation size is 1050x700

Presenting

    slide-number: true
    hash-type: number

Hide slide: ## Slide Title {visibility="hidden"}

Slides themselves

Title slide

If you exclude title and author from frontmatter, no title slide will be created and you can create your own

Asides

Asides exist: :::{.aside}

Format

• Many bits from Quarto – Markdown Basics etc. apply for presentations as well!

• Comments are HTML comments.

  • Other options exist but it’s still the best one. How to comment out some contents in .qmd files? · quarto-dev/quarto-cli · Discussion #3330

• [this is a div]{.to-which .i-can add="stuff"}

• For slides w/o titles you can still do this

  # {background-image="https://upload.wikimedia.org/wikipedia/commons/2/2b/Ouroboros-Abake.svg" background-position="center" background-size="contain" .center}
  

Centering stuff

• TODO
• Vertical/Horizontal
• Vertically and horizontally centered content in slides (revealjs) · quarto-dev/quarto-cli · Discussion #2951
• css - Vertical Align of images in Quarto Presentations - Stack Overflow

Complex layouts are possible with layouts:

::: {layout="1],[-1,1,1,1,-1"}
![](./images/logos/logo_chatgpt.png){.nostretch width="500px" fig-align="center"}

![](./images/logos/l2.png){.nostretch width="200px"}

![](./images/logos/l1.png){.nostretch width="200px"}

![](./images/logos/l3.png){.nostretch width="200px"}
:::

Classes

## {.classname}

::: {.classname}
div with class=classname
:::

::: {}
div with no class — we still need the {} for it to be a div
:::

::: {.one-div}
:::: {.inside-another}
But the number of : doesn't matter as long as it's >3 — they aren't even matching by count, it's just divs inside divs inside divs, the number of : is just for readability
::::
:::

Plugins

Attribution

quarto-ext/attribution: Display attribution text sideways along the right edge of Revealjs slides.

format:
	revealjs: ...
revealjs-plugins:
  - attribution
---

## attribution
![testatt](./images/logos/logo_chatgpt.png){.nostretch width="600px" fig-align="center"}

::: {.attribution}
Photo courtesy of [@ingtotheforest](https://unsplash.com/@ingtotheforest)
:::

Roughnotation

EmilHvitfeldt/quarto-roughnotation: An extension that uses the roughnotation javascript library to add animated annotations to revealjs documents.

R to run.

Sample presentation: RoughNotation; its source: quarto-roughnotation/example.qmd at main · EmilHvitfeldt/quarto-roughnotation

---
title: Simple roughnotation setup
filters:
   - roughnotation
---

- [type]{.rn rn-type=circle}
- [animate]{.rn rn-animate=false}
- [animationDuration]{.rn rn-animationDuration=20000}
- [color]{.rn rn-color=blue}
- [strokeWidth]{.rn rn-strokeWidth=3}
- [multiline multiline multiline multiline multiline multiline multiline multiline multiline multiline]{.rn rn-multiline=true}
- [iterations]{.rn rn-iterations=1}
- [rtl]{.rn rn-rtl=false}

also

{.rn rn-type=underline}

Key bits:

And this will be [circled]{.rn rn-type=circle rn-color=orange}
and [underlined]{.rn rn-type=underline rn-color=orange rn-animate=false}
and [boxed]{.rn rn-type=box rn-color=blue rn-animate=false}
and [crossed]{.rn rn-type=crossed-off rn-color=blue rn-animate=false}
and [crossed again]{.rn rn-type=strike-through rn-color=blue rn-animate=false}

rn-index=2 for order so that the animations happpen one after the other

Works for entire divs as well: RoughNotation

Problems with RN

It highlights the wrong places for me if the presentation is too narrow, both on mobile and desktop browsers; zooming out helps but too much breaks it again. EDIT: a known issue mentioned in the last slide of the sample presentation, they also suggest zooming.

EDIT: No one said I have to use half a screen for previewing, this is a nice layout that solves multiple problems:

Themes

Quarto – Reveal Themes

Default theme: quarto-cli/src/resources/formats/revealjs/quarto.scss at main · quarto-dev/quarto-cli

Centering everything

/*-- scss:defaults --*/
$presentation-slide-text-align: center !default;

format: 
  revealjs:
    theme: [default, my_scss_file.scss]

BUT for some things it’s ugly, like lists. Then:

.notcenter {
  text-align: left;
}

## UA-CBT
### Outline 
::: {.notcenter}
- English example
	- Morphology
	- Agreement
:::

Smaller

{.smaller} works on full slides only, this works for divs too:

.newsmaller {
	font-size: calc(#{$presentation-font-size-root} * #{$presentation-font-smaller});
}

Increasing slide number size

.reveal .slide-number {
	font-size: 30px !important;
}

Cool links from elsewhere

• Slidecraft 101: Colors and Fonts
• Meghan Hall

Both linked by the excellent and thorough Beautiful Reports and Presentations with Quarto

References / citations

Quarto – Citations & Footnotes

.biblatex file exported from Zotero and optonally a CSL style (citation-style-language/styles: Official repository for Citation Style Language (CSL) citation styles.)

bibliography: ../../Masterarbeit.bib
csl: ./diabetologia.csl
--- 

# etc. In diabetologia this gives the usual [1] thingies.
[@key]
[see @key]

Then autocomplete in vim-quarto (!)

Dynamism and animations

Incremental lists are {.incremental}, or the entire presentation can be

  revealjs:
    incremental: true  

with {.nonincremental} parts.

Otherwise Fragments¹ exist with more control.

r-stack allows to make images overlapping: Quarto – Advanced Reveal

Simple template for slides with everything

## Title {.smaller}
::: {.notcenter}
Descr.

:::: {.incremental}
- some
- list
::::
:::

<!-- footnotes here if needed
[^leaderboard]: <https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard>
-->

::: {.notes}
sp. notes.
:::

::: footer
Chapter - Section
:::

Bits

CSS inside slides

The excellent page of quarto presentation tricks Meghan Hall has this:

Text with [red words]{style="color:#cc0000"}.

No special CSS classes needed!

The book by Better Posters’s author is freaking awesome. Short summary follows, not copypasting too much because copyright, but the book is 12/10.

Chapter 1: short form

TL;DR how to do a poster if you read only one chapter

• Three columns, margins around them and between them at 50mm
• so 8 inches/200mm for the margins toatl

• take the width of your paper, subtract 8 inches (200 mm) for the margins,

and divide by three to find your column width. If your poster is 48 inches (1,220 mm), your columns will be 13⅓ inches (340 mm) wide. Yes, it’s an awkward number, but computers don’t care.

Short note to self

• A0 is 841 x 1189mm¹
  • My arm is around 70cm
• Later the recommendation is 6 columns because flexibility
• So now it’s margins 50mm top/down/l/r w/ columns like this

> cc (1189-100)/6
181.5
> cc (841-100)/6
123.5

After playing around, this is good enough I guess! (Ignore Y grid)

After ignoring even more advice: (EDIT: oh damn it’s 7, not 6!)

Bits

• To look for typos, changing the font and column size helps! p. 49

Narrative

• Narrative
  • AND, BUT, THEREFORE (ABT) p.59
    • We scanned the salmon AND saw brain activity BUT this is impossible THEREFORE we should …
  • Find a narrative and keep it in mind when doing the poster; get other people to do their narrative and see if it’s at least close to yours

Visual thinking (p.64 Chapter 7)

Quoting directly because it’s freaking awesome.

• “Dan Roam argues that there are six basic ways to show something, and you can recognize which you need by the kind of question you hear (Roam 2013)”:
  • If you hear a name – a “who or what” – you need a portrait. This is not necessarily a realistic or detailed portrait like a painting or a posed photo. A stick and ball chemical structure is a “portrait” of a molecule. A smiling emoji can be a portrait.
  • • If you hear a number – a “how many” – you need a chart or graph. A bar graph is a simple example.
  • • If you hear a location or a list – a “where” – you need a map. Again, this need not be a literal cartographic map. Anytime you talk about something “above,” “below,” “closer,” or “overlapping,” you have the potential to create a map. Examples include concept maps, pedigrees and phylogenies, org charts and Venn diagrams.
  • • If you hear a history – a “when” – you need a timeline. “Time” is one of the most common variables shown graphically (Tufte 2001).
  • • If you hear a sequence or process – a “how” – you need a flowchart.
  • • If you hear some complex combinations – a “why” – you need a multi-variable plot, like a scatterplot.

• Design is making things look similar (consistency, grids, fonts) and different (h2 vs the text, etc.)

• Main rules:

  • repetition, alignment, contrast, proximity

• p.85 100-300 dpi is the sweet spot for posters

• 108 when deciding how much to narrow/widen a line graph, aim for a max slope of about 45 degrees

• 153 a font family is designed so that different fonts look OK together — DAMN.

Grids

The most important takeaway.

• 165 “layouts that never work”
  • [--][ ] two wides one tall
  • [-] [-----] swedish flag
• Numerate the order if it’s not obvious
• Vary the place of the break so it’s not squares (right?down?) but obviously rows or columns:

Bad:

[   ][    ]
[   ][    ]

Good:

[     ][  ]
[   ][    ]

Text

• p.191 has a list of cliches to replace, e.g. “make use of” -> “use” and “the use of” -> (Omit)
• all-caps headers are worse because you can’t see the shape of the words — which is important from far away.
• serif or no serif doesn’t really matter from a design perspective.

Before you print

221 checklist and ratings

Practical bits

• Get a document tube! (And write your name on it!)
• How to do conferences shoes to stand in for hours, tacks, PDF to print it if sth happens etc.

Not from Better Posters

Random gray or whatever color stripes can live up a white background

See also

• Layout and structure - Research Posters - LibGuides at Sheffield Hallam University

• Another (CC!) book on this: Scientific Posters: A Learner’s Guide – Simple Book Publishing

\begin{description}
\item[Brown-UK\footnote{\href{https://github.com/brown-uk/corpus}{https://github.com/brown-uk/corpus}}] is an open, balanced ..

Nope. It’s like tables — you’ll get the mark but not the actual footnote. Hard to notice.

Have been using it casually but now I wanted a quick way to follow internal links in my Thesis and go back.

Zathura can do this and not just this apparently!

zathura(1) — Arch manual pages

• Tab goes to index mode, where space/enter follow the link in the index
• f shows links that can be followed by typing the number and then enter
• ^o, ^i: Move backward and forward through the jump list! Practically ^o is basically “go back”.

It even has a config file, with remapping, design and stuff zathurarc(5) — Arch manual pages

Downsides:

• the numbers shown w/ f are too small, and no way to change them
• the follow-on-single-click option is in newer version than what I have access to (I should reinstall my system actually)

Fought long and hard on this till I got enlightened. The trivial stupid way works.

\providecommand{\dagtab}{%
{\textsuperscript{\dag}}
}
\providecommand{\asttab}{%
{\textsuperscript{*}}
}

% put it wherever in the table

\caption[Evaluation scores]{Scores of selected models. 

\dagtab LMES tasks (shortened for brevity)

This was so easy.

\ddag double dagger also exists
! as well

… is hard and nothing worked. If it’s over the margin at least.

After trial and error I got this¹.

% \centerline{
\begin{table}[t]
% \begin{center}
\footnotesize
\centering
    \addtolength{\leftskip} {-2cm} % increase (absolute) value if needed
    \addtolength{\rightskip}{-2cm}
% \begin{adjustbox}{center}
% \resizebox{1.0\textwidth}{!}{% Adjust the scale as needed
\begin{tabular*}{1.25\textwidth}{lrrrrrrrrr}
\hline
                          &   LOW &   WIS &   cats\_bin &   cats\_mc &   wordalpha &   wordlength &   UA-CBT &   UP-masked &   UP-unmasked \\
\hline
 BASELINE-human           &       0.97 &       0.94 &            0.97 &           0.98 &             0.92 &              0.94 &     0.94 &        0.84 &          0.88 \\
 BASELINE-random          &       0.09 &       0.05 &            0.50 &           0.20 &             0.50 &              0.50 &     0.17 &        0.10 &          0.10 \\
 Mistral-7B-Instruct-v0.2 &       0.34 &       0.19 &            0.59 &           0.71 &             0.48 &              0.71 &     0.46 &        0.75 &          0.86 \\
 Ms-Inst-Ukr-SFT          &       0.31 &       0.16 &            0.66 &           0.55 &             0.48 &              0.66 &     0.42 &        0.82 &          0.87 \\
 Ms-Inst-Ukr-Slerp        &       0.35 &       0.19 &            0.66 &           0.66 &             0.49 &              0.70 &     0.45 &        0.79 &          0.87 \\
 Ms-Inst-Ukr-sherl        &       0.37 &       0.19 &            0.69 &           0.76 &             0.50 &              0.75 &     0.55 &        0.88 &          0.92 \\
 gpt-3.5-turbo            &       0.68 &       0.34 &            0.68 &           0.91 &             0.78 &              0.89 &     0.61 &        0.77 &          0.86 \\
 gpt-4-1106-preview       &       0.67 &       0.39 &            0.86 &           0.93 &             0.85 &              0.95 &     0.97 &        0.96 &          0.97 \\
\hline
\end{tabular*}
% }
% \end{adjustbox}
% \caption[Evaluation scores]{\TODO{Scores of selected models}}
\label{tab:eval}
% \end{center}
\end{table}
% }

The width 1.25\textwidth has to be manually chosen otherwise the table lines are too long or short for the text.

If it’s too low or too high it causes this (left is low):

As usual, when doing these things, Overleaf’s draft mode is golden.

For positioning on the page, quoting Overleaf²:

The parameter `h!` passed to the table environment declaration establishes that this table must be placed _here_, and override LATEX defaults. The positioning parameters that can be passed-in include:

`h`
Will place the table _here_ approximately.

`t`
Position the table at the _top_ of the page.

`b`
Position the table at the _bottom_ of the page.

`p`
Put the table in a special page, for tables only.

`!`
Override internal LATEX parameters.

`H`
Place the table at this precise location, pretty much like h!.

Comma after ‚i.e.‘ and ‚e.g.‘ – Business English & Übersetzungen:

• i.e. means that is / in other words (from id est)
• e.g. means for example

They are followed by commas in American English but not in British English.

The UNLP workshop generously included a 3 months trial of Grammarly Premium, and this was interesting.

• Shown in Fig. XXX

• Oxford commas — Grammarly wants them, I seem to not, but I should decide on one

• it specified the requirements, THE complexity of the story, … — when I list things I can’t use one article for all of them!

  • I would never write “I have a cat, dog, rabbit”, and that’s the same thing

• e.g. requires a comma only in American English

• I do A LOT of errors with duplicated words (the the)

  • A book I’m reading suggests using a different font and column width when proofreading just to catch such things

• I don’t know how to spell a number of English words

  • accommodate

• Many typos are acoustical ones if I’m tired, e.g. doc instead of dog

• I use too many words

  • A lot of my passive can be really neatly rephrased into not-passive, for shorter sentences with fewer words
  • verb+noun often can be just a better verb (like make predictions => predict)

• it removes many of my commas

  • I know it’s my Slavic language interference, but in many cases it makes the text way less clear imo

General impressions

• It even knows that written in python requires Python to be capitalized!

kubectl cp failed with errors, so.

file.io - Super simple file sharing

(rapids) root@lm-eval-sh:/data/output# curl -F "file=@more.zip" https://file.io

{"success":true,"status":200,"id":"xxx","key":"xxx","path":"/","nodeType":"file","name":"more.zip","title":null,"description":null,"size":46277219,"link":"https://file.io/xxx","private":false,"expires":"xxx","downloads":0,"maxDownloads":1,"autoDelete":true,"planId":0,"screeningStatus":"pending","mimeType":"application/octet-stream","created":"2024-04-16T15:19:10.227Z","modified":"2024-04-16T15:19:10.227Z"}

Generally, free curl file sharing online - Google Suche returns many services with potential.

With the help of ChatGPT

\documentclass{article}
\usepackage{titlecaps}
\usepackage{etoolbox}

% Specify words to remain in lowercase unless they are the first word
\Addlcwords{the and but or nor for a an at by to in on with of}

\let\oldchapter\chapter
\renewcommand{\chapter}[1]{\oldchapter{\titlecap{#1}}}

\let\oldsection\section
\renewcommand{\section}[1]{\oldsection{\titlecap{#1}}}

\let\oldsubsection\subsection
\renewcommand{\subsection}[1]{\oldsubsection{\titlecap{#1}}}

\begin{document}

\section{an example of a section with and without uppercasing specific words}
This is some text.

\subsection{exploring the integration of tools in the workplace}
More text here.

\end{document}

seaborn.barplot — seaborn 0.13.2 documentation:

passing order=[list,of,cats,in,order] decides the ordering.

Otherwise “it will be inferred” except that it’s not always trivial to understand how exactly (or I’m too sleep-deprived).

And if I’m drawing horizontal lines on top of the bars in the barplot based on indexes then the order may be sligthly different.

The same thing can have multiple names and that’s alright!

\label{old-subsection-name-maybe-linked-to-elsewhere}
\label{sec:eval-task-2}

Margin notes - Overleaf, Online-LaTeX-Editor:

\marginpar{text} is the vanilla option, but this works in all cases ever:

\usepackage{marginnote}
\marginnote{text}

EXCEPT I couldn’t find a way to add footnote markers to have numbered margin notes separate from the real footnotes.

But this solves everything, quoting directly¹:

\newcounter{mgncount}
\renewcommand\themgncount{\arabic{mgncount} }
\newcommand\marginfootnote[1]{\refstepcounter{mgncount}\marginpar{{$^\themgncount$}#1}\footnotemark}

\begin{document}
Can we put a footnote with number in the margin and a number in the text?\marginfootnote{There's a number here!}

Another test\marginfootnote{Working!}

One more try\marginfootnote{Successful!}
\end{document}

EDIT: actually it doesn’t and uses the number from footnotes in the text itself. :(

Ah, the sidenotes package exists: https://ctan.math.utah.edu/ctan/tex-archive/macros/latex/contrib/sidenotes/sidenotes.pdf

But uses only 1…3-type numbers.

Yes this is it! CTAN: Paket sidenotesplus

%\usepackage{sidenotes}
\usepackage[mark=Alph]{sidenotesplus}
...

\sidenote{does basically what footnote does}

It has a lot of options and can do a lot of things, yes, this is it, it’s perfect. The example page has everything: https://ctan.math.illinois.edu/macros/latex/contrib/sidenotesplus/tests-sidenoteplus.pdf

See also CTAN: Marginal topic.

marginpar - Footnote and number in margin - TeX - LaTeX Stack Exchange

symbols - What is the best way to use quotation mark glyphs? - TeX - LaTeX Stack Exchange:

``this'' / `this' is the proper way
"this"/'this' produces two closing quotes and 'is annoying to readers'

There’s also CTAN: Package csquotes that ‘is fantastic’, including smartly doing nested quotes, correct quotes for diff languages, and ‘generally always doing what you want it it’:

\usepackage[autostyle]{csquotes}

...
\enquote{My quoted text}

Another answer suggests

\newcommand{\q}[1]{``#1''}

...

\q{whatever}

I’ve been using more custom latex commands lately and this goes in that direction.

I guess creating a \q that does autoquotes w/ csquotes is the way to go?

• Punctuation

  • all citations to word~/cite{xxx}.
  • all footnotes to sentence.\footnote{}¹
    • either full sentence or lowercase part
    • but within parentheses!
  • for both, it’s sent~\cite{}.\footnote{}
  • all numbers to 132,32.99
  • Consistent quoting (using the correct latex quotes or \enquote{} with italics for longer sentences.)
  • all refs to autorefs
    • Autoref fails with appendix subsections, do it manually.
  • tightlists everywhere
  • Overleaf ‘stop on first error’ to fix the errors
  • Title Case in all Titles

• Bits

  • CBT-UA -> UA-CBT
  • LMentry-static-UA shorten to LMES once and keep using LMES.
  • Eval-UA-tion should be captialized
  • Thesis always capitalized
  • gpt2/GPT2 -> GPT-2.
  • check for stray ‘we’s in the paper
    • “our”/“we” “paper”
  • look for sticking out over-the-line bits
  • Python is capitalized
  • all Grammarly suggestions

• Not bits

  • go through all latex comments
  • go through all latex warnings
  • go through all todos in home.md + taskwarrior

====== Open research questions:

• Research
  • look into whether translated datasets are worse at stuff
  • monolingual VS multilingual models incl Ukrainian performance
  • Whether prompt language makes a differenec on Ukrainian task
• Datasets:

SH, [10 Apr 2024 14:58:39] LMES — дослідити robustness моделей, і наприклад глянути яка залежність accuracy людей і ШІ в залежності від мммм різниці в довжині слів чи номеру слова (“яке стотринадцяте слово в реченні …”) CBT-UA — нормально evaluate, а ще для людей і машин — глянути scores якщо давати тільки challenge segment. Я це тестив з нейромережами (не попало в paper), але там дуже часто були кращі результати з фрагментом ніж з усією казкою

SH, [10 Apr 2024 14:59:57] Зробити датасет по biases і фемінітивам, у мене написаний код для генерації нульової версії, там по суті речення типу “моя жінка займається програмуванням компʼютерних систем, тобто за професією вона — ….”

SH, [10 Apr 2024 15:00:20] Мрія всього життя таки зробити Russian-Ukrainian interference dataset на предмет русизмів та російських помилок

SH, [10 Apr 2024 15:02:57] UA-CBT — взяти казки з project Gutenberg, взяти іноземні казки перекладені українською, і порівняти scores моделей на тасках по казкам з цих різних джерел. Можна забити на фільтрацію, чисто зробити human baseline на частині згенерованого датасету. Так можна зробити нереально великий датасет і знати що там максимум умовнио 80% бо 20% тасків сміття

Also:

• CATSMC and friends — much larger datasets can be generated from the given data, a lot of combinations are possible.

\autoref is like \ref but it adds the word, not just the number. 3.2 -> Figure 3.2 : cross referencing - What’s the difference between \ref and \autoref? - TeX - LaTeX Stack Exchange

j

Wrapping stuff in this command makes it stand out; also greppable by TODO which removes the need to remember commands

\newcommand{\TODO}[1]{{\color{magenta}#1}}

Previously:

• 240218-2049 Huggingface dataset build configs

Is there a suggested way of debugging dataset generators? - 🤗Datasets - Hugging Face Forums

Instead of committing etc. every time, one can clone the dataset path locally through git and then point load_dataset() to that local folder with the dataset script file!

Random nugget from Document to compress data files before uploading · Issue #5687 · huggingface/datasets:

• gz, to compress individual files
• zip, to compress and archive multiple files; zip is preferred rather than tar because it supports streaming out of the box

(Streaming: https://huggingface.co/docs/datasets/v2.4.0/en/stream TL;DR don’t download the entire dataset for very large datasets, add stream=true to the load_dataset() fn)

Til from NASA’s (!) docs¹ that there are two sub-levels after subsubsection:

\subsubsection{Example Sub-Sub-Section}
\label{sec:example-subsubsection}

\ref{sec:example-subsubsection} is an example of \texttt{subsubsection}.

\paragraph{Example Paragraph}
\label{sec:example-paragraph}

\ref{sec:example-paragraph} is an example of \texttt{paragraph}.

\subparagraph{Example Sub-Paragraph}
\label{sec:example-subparagraph}

\ref{sec:example-subparagraph} is an example of \texttt{subparagraph}.

I so needed them!

Goal: create multiple dataset configs for 231203-1745 Masterarbeit LMentry-static-UA task.

• Example: datasets/templates/new_dataset_script.py at main · huggingface/datasets
• Tutorial: Builder classes
  • One example they give: https://huggingface.co/datasets/frgfm/imagenette/blob/main/imagenette.py

Developing:

• One can in _URLS provide paths to local files as well, to speed up development!

It’s not magic dictionaries, it’s basically syntax known to me (with Features etc.) which is neat!

                elif self.config.name == "WhichWordWrongCatTask":
                    yield key, {
                        "question": data["question"],
                        "correctAnswer": data["correctAnswer"],
                        "options": data["additionalMetadata_all_options"]
                        #  "second_domain_answer": "" if split == "test" else data["second_domain_answer"],
                    }

Ah, dataset viewer not available :( But apparently one can use manual configs and then it works: https://huggingface.co/docs/hub/datasets-manual-configuration

I can use https://huggingface.co/datasets/scene_parse_150/edit/main/README.md as an example here.

dataset_info:
- config_name: scene_parsing
  features:
  - name: image
    dtype: image
  - name: annotation
    dtype: image
  - name: scene_category
    dtype:
      class_label:
        names:
          '0': airport_terminal
          '1': art_gallery
	  '2': badlands
- config_name: instance_segmentation
  features:
  - name: image
    dtype: image
  - name: annotation
    dtype: image	

… This shows WISTask in the viewer, but not LOWTask (because 'str' object has no attribute 'items' )

configs:
- config_name: LOWTask
  data_files: "data/tt_nim/LOWTask.jsonl"
  features: 
  - name: question
    dtype: string
  - name: correctAnswer
    dtype: string
  default: true
- config_name: WISTask
  data_files: "data/tt_nim/WISTask.jsonl"

And I can’t download either with python because

Traceback (most recent call last):
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/builder.py", line 1873, in _prepare_split_single
    writer.write_table(table)
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/arrow_writer.py", line 568, in write_table
    pa_table = table_cast(pa_table, self._schema)
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/table.py", line 2290, in table_cast
    return cast_table_to_schema(table, schema)
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/table.py", line 2248, in cast_table_to_schema
    raise ValueError(f"Couldn't cast\n{table.schema}\nto\n{features}\nbecause column names don't match")
ValueError: Couldn't cast
question: string
correctAnswer: string
templateUuid: string
taskInstanceUuid: string
additionalMetadata_kind: string
additionalMetadata_template_n: int64
additionalMetadata_option_0: string
additionalMetadata_option_1: string
additionalMetadata_label: int64
additionalMetadata_t1_meta_pos: string
additionalMetadata_t1_meta_freq: int64
additionalMetadata_t1_meta_index: int64
additionalMetadata_t1_meta_freq_quantile: int64
additionalMetadata_t1_meta_len: int64
additionalMetadata_t1_meta_len_quantile: string
additionalMetadata_t1_meta_word_raw: string
additionalMetadata_t2_meta_pos: string
additionalMetadata_t2_meta_freq: int64
additionalMetadata_t2_meta_index: int64
additionalMetadata_t2_meta_freq_quantile: int64
additionalMetadata_t2_meta_len: int64
additionalMetadata_t2_meta_len_quantile: string
additionalMetadata_t2_meta_word_raw: string
additionalMetadata_reversed: bool
additionalMetadata_id: int64
system_prompts: list<item: string>
  child 0, item: string
to
{'question': Value(dtype='string', id=None), 'correctAnswer': Value(dtype='string', id=None), 'templateUuid': Value(dtype='string', id=None), 'taskInstanceUuid': Value(dtype='string', id=None), 'additionalMetadata_kind': Value(dtype='string', id=None), 'additionalMetadata_template_n': Value(dtype='int64', id=None), 'additionalMetadata_all_options': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None), 'additionalMetadata_label': Value(dtype='int64', id=None), 'additionalMetadata_main_cat_words': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None), 'additionalMetadata_other_word': Value(dtype='string', id=None), 'additionalMetadata_cat_name_main': Value(dtype='string', id=None), 'additionalMetadata_cat_name_other': Value(dtype='string', id=None), 'additionalMetadata_id': Value(dtype='int64', id=None), 'system_prompts': Sequence(feature=Value(dtype='string', id=None), length=-1, id=None)}
because column names don't match

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "test.py", line 18, in <module>
    ds = load_dataset(path, n)
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/load.py", line 1797, in load_dataset
    builder_instance.download_and_prepare(
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/builder.py", line 890, in download_and_prepare
    self._download_and_prepare(
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/builder.py", line 985, in _download_and_prepare
    self._prepare_split(split_generator, **prepare_split_kwargs)
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/builder.py", line 1746, in _prepare_split
    for job_id, done, content in self._prepare_split_single(
  File "/home/sh/.local/lib/python3.8/site-packages/datasets/builder.py", line 1891, in _prepare_split_single
    raise DatasetGenerationError("An error occurred while generating the dataset") from e
datasets.builder.DatasetGenerationError: An error occurredwhile generating the dataset

Oh goddammit. Relevant:

• pytorch - Load dataset with datasets library of huggingface - Stack Overflow
• python - Huggingface datasets ValueError - Stack Overflow is an issue because he loaded it locally
• machine learning - Huggingface Load_dataset() function throws “ValueError: Couldn’t cast” - Stack Overflow also Ukrainian

I give up.

Back to the script.

Last thing I’ll try (as suggested by tau/scrolls · Dataset Viewer issue: DatasetWithScriptNotSupportedError):

Convert Dataset To Parquet - a Hugging Face Space by albertvillanova

…

feels so unsatisfying not to see the datasets in the viewer :(

tau/scrolls · Dataset Viewer issue: DatasetWithScriptNotSupportedError this feels like something relevant to me. We’ll see.