har-dulcify (2/2)

Category index page 2 of 2 pages, listing 69 out of 169 entries in the category har-dulcify.

Expand URLs much more, fix expanded URL references, add isInternalDomain, isExternalDomain, isSuccessful classification

Rename boolean json name checking function to the opposite

Try to be more strict with type checking checking for failed requests

Fix GTM question parallelization problem by splitting up work to preparation and aggregation

Add Google Tag Manager question

Look at second level domains in domain lists

Domain list preparation script for the .se health check domains

Don't crash on null mime parameter value (charset) strings

Use empty objects instead of ugly null values

Fix hacky malformed mime fix not returning mime parts

Parallelize parts of the data transformations

Try to protect against paths with unusual characters

Create disconnect dataset analysis as part of preparations

Run aggregate preparations in parallel

Explictly arithmetic comparison

Experimental parallelized map/reduce code for the final aggregation steps

Delete duplicated functions

Hack fixes for malformed/empty urls and mime types

Filter HAR data on failure/success of the initial request

Only look for .har files

Move and remove functions

Add domains-per-organization analysis

Remove space that snuck into search-replace once

Output CSV based on an array of objects

Use @text instead of tostring

Add analysis of disconnect's blocking

Add coverage/percentage calculations

Define lookups as functions instead of variables, use replace for strings

Output the different possible json paths in an object

See discussion regarding the `show-struct` tool by @ilyash.
https://github.com/ilyash/show-struct
https://github.com/stedolan/jq/issues/243

Add a basic aggregate analysis

Add groups to mime-types

Allow taking of objects from the end of the array

Produce distinct values per domain

Added basic aggregates script

Script to take elements from a JSON array

Link to RFCs for content/mime-types

Mangle properties instead of building a new object

Download disconnect's services.json as part of the preparations

Add domain name groups according to Mozilla's effective tld name list, to avoid some second level domain grouping issues with for example .co.uk.

Split domains to parts

Remove code to detect malformed HAR files

Find malformed HAR files from a list of paths

Remove simple scripts

A single script to run preparations, and a single script to extract data

Instead of reading files from paths, use an external cat and read from stdin

Check if headers exists before extracting the referrer

Default domain listing to current directory

Best practice to define bash script

Transform disconnect's services.json file to a format that's faster to make lookups against, with speedups of about 99.6%

Speed up disconnect matching by about 40% by not splitting key-value objects several times