>>18996752
De-Duplicating 'Wizardry’
Before the search warrant was issued, the Midyear team argued that the project was too vast to complete before the election. According to Comey’s recently published memoir, they insisted it would take "many weeks" and require the enlistment of "hundreds of FBI employees." And, they contended, not just anybody could read them: “It had to be done by people who knew the context,” and there was only a handful of investigators and analysts who could do the job.
“The team told me there was no chance the survey of the emails could be completed before the Nov. 8 election,” Comey recalled, which was right around the corner.
But after Comey decided he’d have to move forward with the search regardless, Strzok and his investigators suddenly claimed they could finish the work in the short time remaining prior to national polls opening.
At the same time, they cut off communications with the New York field office. “We should essentially have no reason for contact with NYO going forward on this,” Strzok texted Page on Nov. 2.
Strzok followed up with another text that same day, which seemed to echo earlier texts about what they viewed as their patriotic duty to stop Trump and support Clinton.
“Your country needs you now,” he said in an apparent attempt to buck up Page, who was “very angry" they were having to reopen the Clinton case. “We are going to have to be very wise about all of this.”
“We’re going to make sure the right thing is done,” he added. “It’s gonna be ok.”
Responded Page: “I have complete confidence in the [Midyear] team.”
“Our team,” Strzok texted back. “I’m telling you to take comfort in that.” Later, he reminded Page that any conversations she had with McCabe “would be covered under atty [attorney-client] privilege."
Suddenly, however, the impossible project suddenly became manageable thanks to what Comey described as a “huge breakthrough.” As the new cache of emails arrived, the bureau claimed it had solved one of the most labor-intensive aspects of the previous Midyear investigation – having to sort through the tens of thousands of Clinton emails on various servers and electronic devices manually.
Advanced new “de-duplicating" technology would allow them to speed through the mountain of new emails automatically flagging copies of previously reviewed material.
Strzok, who led the effort, echoed Comey’s words, later telling the IG’s investigators that technicians were able “to do amazing things” to “rapidly de-duplicate” the emails on the laptop, which significantly lowered the number of emails that he and other investigators had to individually review manually.
But according to the IG, FBI’s technology division only “attempted” to de-duplicate the emails, but ultimately was unsuccessful. The IG cited a report prepared Nov. 15, 2016, by three officials from the FBI’s Boston field office. Titled “Anthony Weiner Laptop Review for Communications Pertinent to Midyear Exam,” it found that “[b]ecause metadata was largely absent, the emails could not be completely, automatically de-duplicated or evaluated against prior emails recovered during the investigation.”
The absence of this metadata – basically electronic fingerprints that reveal identifying characteristics such as To, CC, Date, From, Subject, attachments and other fields – informed the IG’s finding that “the FBI could not determine how many of the potentially work-related emails were duplicative of emails previously obtained in the Midyear investigation.”
Contrary to Comey’s claim, the FBI could not sufficiently determine how many emails containing classified information were duplicative of previously reviewed classified emails. As a result, hundreds of thousands of emails were not actually processed for evidence, law enforcement sources say.
“All those communications weren’t ruled out because they were copies, they were just ruled out,” the federal investigator with direct knowledge of the case said. The official, who wished to remain anonymous, explained that hundreds of thousands of emails were simply overlooked. Instead of processing them all, investigators took just a sample of the batch and looked at those documents.
After Comey announced his investigators wrapped up the review in days – then-candidate Donald Trump expressed skepticism. “You can’t review 650,000 emails in eight days,” he said during a rally on Nov. 7.
He was more correct than he knew.