Archive for the ‘Open Source Intelligence’ Category

CIA’s Venture Capital Arm, In-Q-Tel, Invests in Social Web Monitoring Firm

Monday, October 19th, 2009

Noah Shachtman, in a Wired exclusive, “U.S. Spies Buy Stake in Firm That Monitors Blogs, Tweets,” discusses the CIA’s venture capital arm, In-Q-Tel, investing in a company named Visible Technologies that monitors the social web. He also reports that the CIA is using Visible’s service. Here’s the news release from Visible.

Schatman Writes:

It’s part of a larger movement within the spy services to get better at using ”open source intelligence” — information that’s publicly available, but often hidden in the flood of TV shows, newspaper articles, blog posts, online videos and radio reports generated every day.

Visible crawls over half a million web 2.0 sites a day, scraping more than a million posts and conversations taking place on blogs, online forums, Flickr, YouTube, Twitter and Amazon. (It doesn’t touch closed social networks, like Facebook, at the moment.) Customers get customized, real-time feeds of what’s being said on these sites, based on a series of keywords,

It’s important to know what the CIA is up to and this article does a good job providing that info.

The rest of the article (worth reading) offers more about what Visible does; comments from Steven Aftergood, editor of Secrecy News; and more about the investment and In-Q-Tel in general.

Source: Wired

Can you name another company that received funding from In-Q-Tel? That’s right, Keyhole Corp. And of course we all know that Keyhole was acquired by Google in 2004 and became Google Earth and used with other Google Map services.

+ In-Q-Tel Invests in Keyhole (June 25, 2003)
+ Google Acquires Keyhole (October 27, 2004)
+ In-Q-Tel Sells 5,636 Shares of Google (November 14, 2005)

The acquisition was reported in many places including the Washington Post, The Register, and InternetNews.com.

Here’s the Keyhole Inc. home page a couple of weeks before the Google acquisition. (via Internet Archive)

Could Visible Technologies and what they offer be ripe for a Google purchase? We know Google is in acquisition mode. Something to think about.

Monster mashup: mapping every plane in the air

Sunday, May 31st, 2009

Monster mashup: mapping every plane in the air

FlightAware slurps up more than 1GB a day in federal radar data in order to map, almost in realtime, every commercial flight in the US. Open source tools provide much of the site’s power, but its users provide the ingenuity.

Source: Ars Technica

Hat tip: BO

POTUS — Memorandum for the Heads of Executive Departments and Agencies: Classified Information and Controlled Unclassified Information

Thursday, May 28th, 2009

Memorandum for the Heads of Executive Departments and Agencies: Classified Information and Controlled Unclassified Information

As outlined in my January 21, 2009, memoranda to the heads of executive departments and agencies on Transparency and Open Government and on the Freedom of Information Act, my Administration is committed to operating with an unprecedented level of openness. While the Government must be able to prevent the public disclosure of information where such disclosure would compromise the privacy of American citizens, national security, or other legitimate interests, a democratic government accountable to the people must be as transparent as possible and must not withhold information for self-serving reasons or simply to avoid embarrassment.

To these ends, I hereby direct the following:

Section 1. Review of Executive Order 12958. (a) Within 90 days of the date of this memorandum, and after consulting with the relevant executive departments and agencies (agencies), the Assistant to the President for National Security Affairs shall review Executive Order 12958, as amended (Classified National Security Information), and submit to me recommendations and proposed revisions to the order.
(b) The recommendations and proposed revisions shall address:

(i) Establishment of a National Declassification Center to bring appropriate agency officials together to perform collaborative declassification review under the administration of the Archivist of the United States;

(ii) Effective measures to address the problem of over classification, including the possible restoration of the presumption against classification, which would preclude classification of information where there is significant doubt about the need for such classification, and the implementation of increased accountability for classification decisions;

(iii) Changes needed to facilitate greater sharing of classified information among appropriate parties;

(iv) Appropriate prohibition of reclassification of material that has been declassified and released to the public under proper authority;

(v) Appropriate classification, safeguarding, accessibility, and declassification of information in the electronic environment, as recommended by the Commission on the Intelligence Capabilities of the United States Regarding Weapons of Mass Destruction and others; and

(vi) Any other measures appropriate to provide for greater openness and transparency in the Government’s security classification and declassification program while also affording necessary protection to the Government’s legitimate interests.

Source: White House Press Office

New: The Citizen Journalist’s Guide To Open Government

Thursday, January 29th, 2009

From the News Release:

“The Citizen Journalist’s Guide to Open Government,” an extensive multimedia e-learning module to help new media makers understand how to obtain public records and get into public meetings, launched today on the Knight Citizen News Network (www.kcnn.org). The guide features a unique interactive map that tells citizens how they can locate open-government information on each of the 50 state Web sites. Easy-to-find information on either the Governor’s or State Attorney General’s Web site gets a thumbs-up ranking. Hard-to-find information earns a thumbs down. Users can:

* Obtain local, state and federal government records.
* Appeal when a records request is denied.
* Take steps if they are excluded from a meeting.
* Learn what’s allowed in their state.
* Understand access to court proceedings.
* Link to more information.

Direct to The Citizen Journalist’s Guide To Open Government

Source: J-Lab

Hat Tip: S.B.

Open Source Intel Rocks — Sorry, It’s Classified

Tuesday, September 23rd, 2008

Open Source Intel Rocks — Sorry, It’s Classified

The head of the CIA doesn’t want you to know what he watches on television.

So-called “open source” intelligence — spook-speak for tidbits taken from newspapers, internet postings, and TV shows — is starting to play a major role in the nation’s spy agencies. That’s a major change, in a world that’s used to relying on secret satellites and clandestine agents. But old habits die hard. Open source intelligence may come from unclassified material that’s available to anyone with a TV or an internet connection. CIA chief Michael Hayden says the finished products have to be kept out of public view. They’re just too sensitive for average folks to see.

Source: Danger Room (Wired)

The Google Controversy — Two Years Later

Wednesday, August 27th, 2008

The Google Controversy — Two Years Later (PDF; 56 KB)

Two years have passed since Google startled the world with its free, online, high-resolution mapping products of the world. Foreign governments expressed their shock and concern about such detailed imagery in the hands of the general populace; their facilities and state secrets exposed to the world. “Today, with the advent of civilian satellites here and abroad, we have opened wide the window on places and events that, not so long ago, only spies could see,” writes Sharon Weinberger.

As the initial shock wore off, five main responses to the “Google threat” emerged from nations around the world: negotiations with Google, banning Google products, developing a similar product, taking evasive measures, and nonchalance. This report discusses foreign reporting and government response to the online mapping revolution after the initial brouhaha.

Source: Open Source Center (via Secrecy News)

Archivist of the United States Establishes “Controlled Unclassified Information Office”

Friday, May 23rd, 2008

From the announcement:

Archivist of the United States Allen Weinstein announced today the establishment of the “Controlled Unclassified Information Office” (CUIO) within the National Archives and Records Administration. Weinstein also announced that William J. Bosanko, director of the Information Security Oversight Office, will head up this newly-formed office.

The Office is being created in response to the Memorandum for the Heads of Departments and Agencies on the Designation and Sharing of Controlled Unclassified Information (CUI) issued by President Bush on May 9, 2008. The Presidential memorandum designated the National Archives as responsible for overseeing and managing the implementation of the CUI framework.

Source: NARA

Database: Online Index to Air Force Historical Records

Thursday, May 22nd, 2008

From Secrecy News

A new searchable index of hundreds of thousands of documents held by
the Air Force Historical Research Agency has been created by private
researchers and posted online.

http://www.airforcehistoryindex.org/

The index does not provide access to the underlying documents, which
must be requested from AFHRA. Nevertheless, it has several interesting
features.

For one thing, it represents a step forward in improving accessibility
to declassified government records. The new Air Force index provides a
simple illustration of what can be done to alert the interested public
to the existence of particular records, and suggests how much more
still needs to be done, including providing online access to the
records themselves.

Second, the new index represents an unusual, implicit public-private
partnership. Researchers gained access to the Air Force bibliographical
data and installed a search engine on top, then posted it online in the
public interest. The researchers said they preferred to remain
anonymous.

United States: Wiretaps Up 20 Percent in 2007

Sunday, May 4th, 2008

From the news release:

The number of intercepted wire, oral or electronic communications — also known as wiretaps — authorized by federal and state courts in 2007 was 20 percent higher than in 2006. Courts issued 2,208 such orders in 2007, compared to 1,839 in 2006, according to The 2007 Wiretap Report.

Source: U.S. Courts

New Version: BBC Monitoring: Free Trial for Academic Libraries

Thursday, May 1st, 2008

Word from the UK’s Publishing Tech (parent of Ingenta) that they are working with BBC Monitoring to launch a new web site and database. Free trials are available for academic libraries around the globe.
From an e-mail received on Wednesday:

It’s a comprehensive source of global current affairs content (it collates content from over 3000 sources in 150 countries) and the web platform has been specifically designed to meet the needs of the academic/institutional market. Our PCG divison is selling the new service and is currently offering free trials to academic libraries – they just need to contact bbcmonitoringlibrary@pcgplus.com to sign up.

To learn more about the new BBC Monitoring service for academic libraries, check this news release.

E-News for ARL Directors (Apr. 14, ‘08)

Monday, April 14th, 2008

These news notes are organized by the strategic directions identified in the ARL Strategic Plan: Scholarly Communication; Public Policies Affecting Research Libraries; and Library Roles in Research, Teaching, and Learning. In addition, there is an initial section for Governance and Membership Activities and complementary sections on Diversity, Professional Workforce, and Leadership Development; Library Statistics and Assessment; and Other Items of Interest to ARL Directors

Source: ARL

New eBook from AskSam: 2009 U.S. Government Budget

Friday, February 15th, 2008

2009 U.S. Government Budget

The Budget of the United States Government, Fiscal Year 2009 contains the Budget Message of the President, information on the
President’s budget and management priorities, and budget overviews organized by agency.

The askSam version of the Budget allows you to search, browse, and analyze the budget text. You can search the budget online or
download it to your computer and search using your copy of askSam or the free askSam Viewer.

Access to Information: Greater Use of Privilege Spurs Concern

Tuesday, January 29th, 2008

Access to Information: Greater Use of Privilege Spurs Concern

The U.S. government has been increasing its use of the state secrets privilege to avoid disclosure of classified information in civil lawsuits, prompting legislation in the Senate that would provide more congressional oversight of the practice.

Chart: Classified Information

Published cases of government use of the state secrets privilege have grown over the past 35 years.

Source: The Washington Post

Lists & Rankings: America’s Richest Counties

Monday, January 28th, 2008

Lists & Rankings: America’s Richest Counties
From the article:
t’s easy to assume that the nation’s richest counties dot the tri-state area around New York City, or San Francisco’s Bay Area. Homeowners there, after all, shell out millions of dollars for small luxuries such as a lawn and a garage.

But while affluent areas such as Nassau County, on New York’s Long Island, and Marin County, just north of San Francisco, boast well-off residents, the nation’s wealthiest live in the D.C. suburbs.

Fairfax County, Va., Loudoun County, Va., and Howard County, Md., top the list of America’s richest counties, which we based on median household income data from the 2006 census. In Fairfax, that number reaches $100,318 a year; Loudoun households pull down a livable $99,371 a year; Howard residents follow at $92,260.

Direct to Complete List of Counties

Source: Forbes

New One-Stop Shop: Global Travel Security Alerts Aggregated by DiplomacyMonitor.com

Thursday, January 17th, 2008

Global Travel Security Alerts from DiplomacyMonitor.com
We regularly write about and link to the excellent work being done at DiplomacyMonitor.com where you can find primary documents (in near real-time) from governments around the globe. All of the content is searchable and is also cached locally.

NEW on the site is Travel Security Alerts at its own url: http://travelsecurityalerts.com/ where you can find alerts from various governments. Useful and interesting to read how the same event or security matter is described by different countries.

The Travel Security Alerts database currently references 3,428 travel alerts and security profiles.

Source: DiplomacyMonitor.com

CIA: FOIA: Reading Room: 43 New Documents Added

Tuesday, January 15th, 2008

CIA: FOIA: Reading Room: 43 New Documents Added
New Documents! 43 new documents have been added to the site.

Source: CIA

Open Source Intelligence (OSINT): Issues for Congress

Monday, December 10th, 2007

Open Source Intelligence (OSINT): Issues for Congress
(PDF; 161 KB)

The collection and analysis of OSINT information will be ultimately judged by its contribution to the overall intelligence effort. Collecting information from open sources is generally less expensive and less risky than collection from other intelligence sources. The use of OSINT may result not only in monetary savings but also in less risk than utilizing sensitive technical and human sources. OSINT can also provide insights into the types of developments that may not be on the priority list for other systems or may not be susceptible to collection through other intelligence approaches — innovative applications of new technologies, shifts in popular attitudes, emergence of new political and religious movements, growing popular discontent, disillusionment with leadership, etc. Supporters of OSINT maintain that the future contribution of the Intelligence Community will be enhanced by its ability to provide detailed information and incisive analyses of such developments. This report will be updated as new information becomes available.

Source: Source: Congressional Research Service (via Federation of American Scientists) (via DocuTicker)