Month 2014-09

Index of 116 entries from September 2014. Entries belong to 6 different categories, including har-portent, masters-thesis, har-dulcify, har-heedless, and masters-thesis-site.

See all entries from 2014.

Updated abstract to match v0.3.1

Remove scrapped time plan

Note to write about blocked domain/organization counts

Wording in abstract

Remove temp files upon script exit

Use stderr for errors

Freshly brewed data from all 72 datasets

Shorten table headers

Write about primary domain

Non-parallel per dataset execution

Use only a single value despite faulty disconnect input

Re-add mistakenly overwritten superdomain counter

Write about Cat and Mouse: Content Delivery Tradeoffs in Web Access

Don't save referer values

Don't keep raw disconnect values

Rename effectlive tld to public suffic, move before classification, add same primary domain as a classification for internal domains

More about results, like requests counts

Expand request count output

Add public suffix coverage, rename disconnect external coverage

Update abstract and introduction

More about Disconnect and Public Suffixes, etcetera

Write about .SE Health Status findings, publix suffixes, other stuff

Add .SE Health Status 2008, 2009, 2010

Disolve many code insets used for project names like jq, phantomjs and har-*

Write about future work, results, update older paragraphs

Add an environment for future work

Write about HTTP response status, non-/failed origins, HTTPS, mime-types

Add request status and mime-type coverage

Add in/secure int/ext/all resources plus mixed domain coverage

Add mixed domain scope

Calculate successful, unsuccessful, non-failed and failed origins

Update table number formatting, some results

Ignore LyX *.emergency files

Run all multiset queries

Multiset disconnect's selected top domains

Shorten column names

Vertically align wide data tables in the middle of the rotated page

Allow landscape/wide pages for wide tables etcetera

Rename and delete sum after using it for sorting

Rename and run disconnect question with the others

Regroup disconnect's categories and organizations

Compare Disconnect's blocked organizations between datasets

Some more multiset table extractions

Rename table function to reflect TSV usage

Replace inline tables with external tsv files

Forgot there was a join(...) call to put the CR in

Use function and local variables for easier code sharing (TBD)

Use pgfplotstable and macros to insert tables from tsv files

Scripts to generate data tables

Use TSV instead of CSV for download retries

Add TSV tools

Break out cleaning CSV headers

End lines with CRLF as per http://tools.ietf.org/html/rfc4180#section-2

Skip forcing @text output and let @csv take care of it

Reuse logic for object to csv row between header and body

Wrote more

More about Contributions to other open source projects

Update domain list table with unique count, tld distribution, mention contributions to other projects, write about P3P policies, update mime-types, etcetera

Write about har-portent, update some code details

Mention The Tangled Web: A Guide to Securing Modern Web Applications

Write about superdomain, insecure classification

Write more about domain lists

Ignore .tex files, as they are supposed to be temporary when generating output from .lyx files

Increase parallelism as failures are more and more certain to be definite.

Add link to har-portent

Made CSS prettier

Released a report draft

A bit about future work etcetera

Thank you Yaffle for URLUtils.js

Make relative redirects absolute to the request that generated it

Remove the single domain downloader, as it's easier to call the single url downloader

Add origin redirect chain question/analysis

Add isInsecure basic classification

Pass Alexa top list as a parameter

Exclude 304 as a redirect

Add is superdomain classification

Download https and www. variations of domains

Script to first download then analyze multiple lists of domains

Re-focus code on downloading URLs, albeit only domain root URLs at this point in time

Basic README.md, LICENSE

Initial commit

Fix find path exclusion by reordering the arguments