HELP
>>5159427 (lb)
>>5159445 (lb)
>>5159450 (lb)
>>5159462 (lb)
Going to raise this one moar time. Need a sanity check anons… that or desperate sleep.
Context: US House Representative Financial Disclosures Search Page returning different number of results than the full, yearly .ZIPs they've posted.
—
ref: http://clerk.house.gov/public_disc/financial-search.aspx
ref: http://clerk.house.gov/public_disc/financial.aspx (full zips found here)
Here's moar sauce, sorry for the fukked formatting. Moving fast and exhausted.
Test Account in 2014 ZIP, not on search site
> cat 2014FD.txt | head -1 && cat 2014FD.txt | grep "Test Account"
Prefix Last First Suffix FilingType StateDst Year FilingDate DocID
Test Test Test Account N CA25 2014 3/29/2017 40000737
2014 .ZIP has 15 Records for CA district 25, search shows only 4 for CA25 in 2014
> cat 2014FD.txt | head -1 && cat 2014FD.txt | grep "CA25"
Prefix Last First Suffix FilingType StateDst Year FilingDate DocID
Castagna Troy C CA25 2014 4/30/2014 10000813
Council Temperance A Lance C CA25 2014 5/9/2014 10001720
Council Temperance A Lance D CA25 2014 5/22/2014 8215425
Hon. Knight Steve A CA25 2014 6/25/2015 10008082
Hon. Knight Steve C CA25 2014 5/15/2015 10007161
Hon. Knight Steve H CA25 2014 5/15/2015 10007260
Hon. Knight Steve X CA25 2014 5/14/2015 9106496
Hon. McKeon Howard P. "Buck" T CA25 2014 1/20/2015 10004663
Puentes Jorge Ricardo Jr D CA25 2014 2/10/2014 40000004
Rogers Lee C. C CA25 2014 5/22/2014 8215392
Singh Navraj C CA25 2014 5/6/2014 10001489
Strickland Anthony A. C CA25 2014 6/16/2014 10002611
Strickland Anthony A. X CA25 2014 5/19/2014 30000475
Test Test Test Account N CA25 2014 3/29/2017 40000737
Thomas Evan Charles C CA25 2014 4/20/2014 10000788
> cat 2014FD.txt | grep "CA25" | wc -l
15
.ZIPs collated have 54 records for CA25, search site shows only 21 (pic attached)
> ls 20*.txt
2008FD.txt 2009FD.txt 2010FD.txt 2011FD.txt 2012FD.txt 2013FD.txt 2014FD.txt 2015FD.txt 2016FD.txt 2017FD.txt
> cat 20*.txt | grep CA25 | wc -l
54
Regarding DWS:
.ZIP .txts collated shows 38 unique records matching non-case-sensitive "wasserman", search site shows 39 ???
$ cat 20*.txt | grep -i "wasserman" | grep -i "FL2." | sort -u
HONORABLE WASSERMAN SCHULTZ DEBBIE A FL20 2011 5/15/2012 8205095
HONORABLE WASSERMAN SCHULTZ DEBBIE A FL20 2012 5/15/2013 8210420
HONORABLE WASSERMAN SCHULTZ DEBBIE O FL20 2008 6/16/2008 8138631
HONORABLE WASSERMAN SCHULTZ DEBBIE O FL20 2009 7/31/2009 8143095
HONORABLE WASSERMAN SCHULTZ DEBBIE O FL20 2010 6/15/2010 8147726
HONORABLE WASSERMAN SCHULTZ DEBBIE O FL20 2011 5/13/2011 8202785
HONORABLE WASSERMAN SCHULTZ DEBBIE O FL20 2012 5/10/2012 8205716
HONORABLE WASSERMAN SCHULTZ DEBBIE O FL23 2013 5/15/2013 9103053
Hon. Wasserman Schultz Debbie O FL23 2014 6/12/2015 10006472
Hon. Wasserman Schultz Debbie O FL23 2015 8/4/2016 10010309
Hon. Wasserman Schultz Debbie O FL23 2016 8/11/2017 10015737
Hon. Wasserman Schultz Debbie O FL23 2017 8/2/2018 10023759
Hon. Wasserman Schultz Debbie P FL23 2015 6/12/2015 20000883
Hon. Wasserman Schultz Debbie P FL23 2015 7/15/2015 20003402
Hon. Wasserman Schultz Debbie P FL23 2015 9/1/2015 20003667
Hon. Wasserman Schultz Debbie P FL23 2015 9/9/2015 20003704
Hon. Wasserman Schultz Debbie P FL23 2016 10/18/2016 20006076
Hon. Wasserman Schultz Debbie P FL23 2016 12/25/2016 20006428
Hon. Wasserman Schultz Debbie P FL23 2016 4/18/2016 20004858
Hon. Wasserman Schultz Debbie P FL23 2016 7/6/2016 20005420
Hon. Wasserman Schultz Debbie P FL23 2017 10/25/2017 20008273
Hon. Wasserman Schultz Debbie P FL23 2017 10/27/2017 20008277
Hon. Wasserman Schultz Debbie P FL23 2017 10/30/2017 20008298
Hon. Wasserman Schultz Debbie P FL23 2017 1/11/2017 20006521
Hon. Wasserman Schultz Debbie P FL23 2017 11/29/2017 20008457
Hon. Wasserman Schultz Debbie P FL23 2017 1/23/2017 20006593
Hon. Wasserman Schultz Debbie P FL23 2017 2/15/2017 20006753
Hon. Wasserman Schultz Debbie P FL23 2017 3/20/2017 20006950
Hon. Wasserman Schultz Debbie P FL23 2017 3/31/2017 20006986
Hon. Wasserman Schultz Debbie P FL23 2017 6/7/2017 20006999
Hon. Wasserman Schultz Debbie P FL23 2017 6/8/2017 20007425
Hon. Wasserman Schultz Debbie P FL23 2017 7/11/2017 20007584
Hon. Wasserman Schultz Debbie P FL23 2017 8/4/2017 20007716
Hon. Wasserman Schultz Debbie X FL23 2014 5/13/2015 30001021
Hon. Wasserman Schultz Debbie X FL23 2015 5/6/2016 30001821
Hon. Wasserman Schultz Debbie X FL23 2016 5/4/2017 30002876
Hon. Wasserman Schultz Debbie X FL23 2017 5/24/2018 9113171
Ms. Wasserman Schultz Debbie O FL23 2013 5/15/2014 10001512
$ cat 20*.txt | grep -i "wasserman" | sort -u | wc -l
38
—
Lots of strange inconsistencies, in general, here.
Ok, I'll stop spamming the shit outta the bread. I think anons get the point.
Lots of inconsistencies here with the US House Rep searchable financial records -vs- the raw data provided in the yearly .ZIPs
—
We need moar eyes here… I wouldn't insist if Q hadn't provided us the following yesterday:
>
>http://clerk.house.gov/public_disc/financial-pdfs/2016/10016846.pdf
>What does a dog do when he/she has a bone?
>You are the news now.
>
>Q
YES! thanks codefag!
I got obsessed with all the inconsistencies between search -vs- ZIPs so table topped the original effort for a bit.
You're the best, fren. Thanks for carrying the original effort to completion.
Number of records anon dumped to JSON:
$ cat fd.json | jq '.[].Member | length' | xargs | tr ' ' '+' | bc -l
19255
>>5158645 (pb)
>>5158756 (pb)
Still running through your JSON dump, but per the first phase outline we may need to revisit #2 for some brief massaging.
For instance FillingTypes of value "P" do not map to "financial-pdfs" slug in the URL. Still filling out the map but here's the gist.
fillingTypeMap = {
"A": "financial-pdfs",
"B": "financial-pdfs",
"C": "financial-pdfs",
"D": "financial-pdfs",
"E": "financial-pdfs",
"G": "financial-pdfs",
"H":
"N":
"O":
"P":
"R":
"T":
"W":
"X":
}