Month 2014-08

Index of 72 entries from August 2014. Entries belong to 7 different categories, including more-tracked-paper, masters-thesis, hexagonif, har-heedless, and jq-hopkok.

See all entries from 2014.

Parallelize domain extraction a bit

Use an available shuf program

Remove unique testing/debugging

Prepare large zones (.com, .net) files

Calculate differences in failed versus non-failed downloads in subsequent datasets where failed domains have been retried.

Use a simplified progress bar when downloading third-party datasets

Use the entire HTTP status 3xx range for redirect detection

Transparent clickable gonifs

Highlight the individual hexagon lines on click, instead of the gonif lines

Draw clickable gonifs/hexagonifs

Simplified running a command on multiple datasets

Fix tailing a null-terminated list

Autostart highlighting

Broke out a couple of utils

Made HighlightOnInterval start/stoppable

Change default presentation values

Standardize event system, build a user activity monitor

Merge branch 'gonif-graph'

General purpose async function queue

Disable gonif neighbor debug lines

Generate gonifs horitzontally then vertically, from the center

Refactor to tee output, more functions

Split and clean up alexa's toplist

Fix google gtm/ga/dc check url reference

Use minimal input data level

More mime-types mapped

Sort and get top results in for public suffix, mime-type counts

Fix private-prefixes by saving a reference to the current public-suffixes, fix picking the primary-domain for distinct URLs

Prevent infinite loops caused by input data being close to chunk size, fallback to merging two and two

More notes

More notes

More writing on random topics

More writing on random topics

Add private-prefixes (as opposed to public-suffixes), aggregated as a single primary-domain

Rename to public-suffixes

Count TLDs

Count all domains in all files

Use bash execution instead of backticks

Updated URL splitting from jq-hopkok

Accidentally referenced an array by name twice

Stricter string type checking

Change ignored scheme blacklist to whitelist

Map more mime-types

Prefilter data before aggregation, to automate grouping

Add requests status to analysis

Don't limit mime-types

Don't limit the public suffix list

Add isUnsuccessful and isFailed request classifications

Also create inverted domain lists, for domain to group lookups

Add .se health status report 2013

Add .se health status report 2013

Add a generic, simple reduce/merge deep addition of object with numbers

Expand URLs much more, fix expanded URL references, add isInternalDomain, isExternalDomain, isSuccessful classification

Use correct project name and tagline

Use github repository URL instead of github page URL

Split an URL into components, join them together

Readme, licenses

Initial commit

Rename boolean json name checking function to the opposite

Try to be more strict with type checking checking for failed requests

HTTPS for Google's font api

Flash files, URL components

Flash files, URL components

Write about data analysis, add placeholder headings

Write about data analysis, add placeholder headings

Write about software considerations downloading domains

Write about software considerations downloading domains

Fix GTM question parallelization problem by splitting up work to preparation and aggregation

Add Google Tag Manager question

Look at second level domains in domain lists

Retrieving websites and resources, spell check

Retrieving websites and resources, spell check