serhii.net

To skip slow tests, first I marked them as…

@pytest.mark.slow
def test_bioconv(tmp_path):
	...

then, in the running configuration, I added the pytest params:

-m "not slow"

(Working with custom markers — pytest documentation)

Using the Python defaultdict Type for Handling Missing Keys – Real Python

Python defaultdict is powerful, copying example from the excellent Real Python page above:

from collections import defaultdict, then things like:

>>> def_dict = defaultdict(list)  # Pass list to .default_factory
>>> def_dict['one'] = 1  # Add a key-value pair
>>> def_dict['missing']  # Access a missing key returns an empty list
[]
>>> def_dict['another_missing'].append(4)  # Modify a missing key

become possible.

God, how many times have I written ugly (or overkill-dataclasses) code for “if there’s a key in the dict, append to it, if not - create an empty list”

Saw this in spacy’s iob_utils.py:

# Fallbacks to make backwards-compat easier
offsets_from_biluo_tags = biluo_tags_to_offsets
spans_from_biluo_tags = biluo_tags_to_spans
biluo_tags_from_offsets = offsets_to_biluo_tags

I hope I never need this but it’s kinda cool!

Pytest has a nice tmp_path fixture that creates a temporary directory and returs the Path¹:

# content of test_tmp_path.py
CONTENT = "content"


def test_create_file(tmp_path):
   d = tmp_path / "sub"
   d.mkdir()
   p = d / "hello.txt"
   p.write_text(CONTENT)
   assert p.read_text() == CONTENT
   assert len(list(tmp_path.iterdir())) == 1

Explicitly adding breakpoint() in a python script is synonymous to adding a pycharm-debugger-breakpoint at that point in the file.

If you have a module inside another module, say two inside one, the syntax for running them from CLI is the same as the one used when importing them (import one.two).

Assuming your working directory contains ./one/two/:

python3 -m one.two --whatever

Use requirements.txt | PyCharm

Tools -> Sync Python Requirements

This syncs the actual project requirements and possibly the installed packages with the given requirements.txt

There’s also a plugin, that autodetects requirements.txt in the root of the project, and then suggests installing missing packages from there etc.

WT recommended Streamlit • The fastest way to build and share data apps

“Streamlit turns data scripts into shareable web apps in minutes. All in pure Python. No front‑end experience required.”

Sample demos:

• BERT Keyword Extractor · Streamlit
• Time series annotations · Streamlit

Other examples are in the Gallery • Streamlit

Awesome Streamlit is freaking awesome.

Connects well to explorables etc., and would replace about 30% of my use-cases for jupyter notebook. Especially random small demos, ones I don’t do because I don’t want to mess with interactive graphs in Jupyterlab or re-learn d3.

Speaking of d3 - I should rewrite Flappy Words in it!

Wrote this small wrapper script that (if a global USE_TQDM parameter is set) uses pretty tqdm lists on lists that have enough elements where it matters. I think I’ll be reusing it.

So when enabled, it will tqdm a list of 150 elements but won’t tqdm a list of 99 elements.

To use:

for el in _tqdm(whatever_list_thing):
	do_stuff_to(el)

Function:

def _tqdm(list_like: Sequence, iflarge: bool = False, lsize: int = 100):
    """Use tqdm if it's on, optionally based on length of list.
    Args:
        list_like: thing to iterate.
        iflarge (bool): If on, will use tqdm only for large lists
        lsize (int): anything more than this is 'large'
    """
    if USE_TQDM:
        if not iflarge:
            return tqdm(list_like)
        else:
            # Count size only if it doesn't mean iterating an iterator
            if isinstance(list_like, Sequence) and len(list_like) > lsize:
                return tqdm(list_like)
    return list_like

git - GitLab: You cannot push commits for . You can only push commits that were committed with one of your own verified emails - Super User

Setting is per-project and lives in push rules:

I set the credentials to the right ones the usual ways:

git config user.email "my@verified-ema.il"

But the commits were still using the old identity.

Solution to fix the last commit by only setting the author to the new / current one:

git commit --amend --reset-author --no-edit