Overview Techniques Tools Frameworks Google Dorks Best Practices Ethics Resources

OSINT (Open Source Intelligence) Guide

What is OSINT?

OSINT (Open Source Intelligence) refers to the collection and analysis of publicly available information to gather insights or intelligence. It is a critical discipline in cybersecurity, corporate investigations, competitive intelligence, threat analysis, journalism, and law enforcement.

Key Insight: Over 80% of intelligence gathered by government agencies and private investigators comes from open sources, not classified or proprietary data. OSINT is not just about collecting data—it's about connecting disparate pieces of information to create actionable intelligence that reveals patterns, relationships, and insights.

OSINT encompasses information from:

OSINT Techniques & Methodologies

Effective OSINT requires mastering multiple techniques and knowing when to apply them based on the investigation type. Professional OSINT investigators use a structured approach:

Social Media Intelligence (SOCMINT)

  • Profile correlation across multiple platforms (Sherlock, Maigret)
  • Post timeline and behavioral pattern analysis
  • Friend, follower, and network connection mapping
  • Geotagged post and check-in location extraction
  • Sentiment analysis and psychological profiling
  • Social graph and influence network analysis
  • Deleted post recovery via archives (Wayback Machine, Pushshift)

Public Records & Government Data

  • Court records, civil litigation, and criminal filings
  • Business registration and corporate entity databases (OpenCorporates)
  • Property ownership and property tax records
  • Voter registration and campaign contribution databases
  • Professional licensing (medical, legal, real estate)
  • Bankruptcy and lien records
  • FOIA (Freedom of Information Act) requests

Technical & Infrastructure Footprinting

  • WHOIS, DNS, and historical DNS record analysis (SecurityTrails, ViewDNS)
  • Subdomain enumeration and discovery
  • Technology stack and software version identification (Wappalyzer, BuiltWith)
  • SSL/TLS certificate transparency log analysis (Crt.sh)
  • Historical website content and change tracking (Wayback Machine)
  • IP address, port, and service scanning (Shodan, Censys)
  • Email server and SPF/DKIM/DMARC configuration analysis

Visual & Geospatial Intelligence

  • Reverse image search across multiple engines (Google, TinEye, Yandex, Baidu)
  • EXIF and metadata extraction from images (ExifTool, Metagoofil)
  • Geospatial location from photos, landmarks, and terrain
  • Face recognition and verification (PimEyes, Search4faces)
  • Satellite imagery analysis (Google Earth, Sentinel Hub)
  • Video frame extraction and analysis
  • Shadow and lighting analysis for timestamp verification

Digital Identity & Breach Intelligence

  • Email header analysis and routing tracing
  • Data breach database correlation (Have I Been Pwned, Dehashed, LeakCheck)
  • Associated username discovery across platforms (WhatsMyName, Namechk)
  • Password reuse and credential stuffing analysis
  • Pastebin and data dump monitoring
  • Dark web monitoring (with appropriate authorization)

Code & Technical Artifact Analysis

  • GitHub/GitLab repository analysis and commit history
  • Exposed API keys, tokens, and credentials in public code
  • Code snippet searching (SearchCode, PublicWWW)
  • Documentation review and technical writing analysis
  • Mobile app APK/IPA metadata extraction
  • Chrome/Firefox extension source code review

Advanced OSINT Methodology: Professional OSINT investigators follow a structured process: 1) Define objectives, 2) Identify data sources, 3) Collect data systematically, 4) Process and organize findings, 5) Analyze and correlate data points, 6) Verify accuracy through multiple sources, 7) Produce actionable intelligence report.

Essential OSINT Tools

These tools are industry standards for OSINT practitioners, investigators, security researchers, and digital forensics examiners. Each tool serves specific use cases in the intelligence gathering lifecycle:

Maltego

Powerful link analysis and data mining tool that visualizes relationships between people, companies, domains, IP addresses, social media profiles, and online identities using transforms (automated data queries).

Shodan

The search engine for internet-connected devices. Find servers, webcams, routers, IoT devices, industrial control systems (ICS), and exposed services globally with detailed banner information.

Google Dorks / Google Hacking Database (GHDB)

Advanced search operators to find specific information, exposed documents, login portals, vulnerable websites, and sensitive files not intended for public access.

SpiderFoot

Automated OSINT reconnaissance tool that gathers intelligence on IP addresses, domains, email addresses, usernames, and names from over 100 public data sources with GUI and CLI interfaces.

Recon-ng

Full-featured web reconnaissance framework written in Python with modular architecture. Includes marketplace for community-developed modules for domain, IP, social media, and breach investigation.

theHarvester

Gathers emails, subdomains, hosts, employee names, and open ports from public sources like search engines (Google, Bing, Baidu), PGP key servers, and LinkedIn.

TinEye

Reverse image search engine with billions of indexed images. Finds where photos appear online, including modified or cropped versions, without relying on metadata.

ExifTool

Read, write, and edit metadata across hundreds of file formats (images, videos, documents, audio). Essential for forensic analysis and metadata extraction.

Censys

Internet-wide scanning platform for discovering hosts, open ports, SSL certificates, and exposed services. More detailed than Shodan for certificate analysis.

Sherlock

Command-line tool to find usernames across over 300 social media platforms, forums, and websites simultaneously. Essential for identity correlation.

Have I Been Pwned (HIBP)

Free resource to check if email addresses, phone numbers, or passwords have been compromised in known data breaches covering over 13 billion accounts.

Wayback Machine (archive.org)

Historical archive of websites showing content changes, deleted pages, and previous versions over time. Critical for investigating content removal and historical claims.

Twint / Snscrape

Advanced Twitter scraping tools that bypass API limitations. Collect tweets, user profiles, followers, and search results without authentication.

GeoCREV / SunCalc

Geolocation verification tools that analyze shadows, sun angles, and landscape features to determine when and where photos were taken.

OSINT Frameworks & Resource Repositories

Comprehensive frameworks that organize OSINT resources, tools, and methodologies. These are essential starting points for any OSINT investigation:

OSINT Framework (osintframework.com)

Curated collection of OSINT tools organized by category (username, email, domain, images, social networks). The go-to web-based resource for investigators starting OSINT research with a visual mind map interface.

IntelTechniques OSINT

Michael Bazzell's comprehensive OSINT methodology, tool repository, and training resources. Includes custom virtual machines, scripts, and the "Open Source Intelligence Techniques" book series.

Bellingcat Online Investigation Toolkit

Open-source investigative toolkit from the renowned investigative journalism organization. Includes geolocation, image verification, social media, and archival tools.

Awesome OSINT (GitHub)

Community-maintained GitHub curated list of OSINT tools, resources, data sources, and methodologies with over 10,000 stars.

i-intelligence OSINT Portal

Professional OSINT training platform and resource directory with categorized tools, case studies, and certification information.

Trace Labs OSINT Virtual Machine

Virtual machine (VM) pre-configured with OSINT tools specifically for missing persons search investigations. Used in Trace Labs CTF (Capture The Flag) events.

Buscador OSINT VM

Virtual machine pre-loaded with open-source intelligence tools for investigators. Includes custom scripts and privacy configurations.

OSINT Combine

Commercial OSINT platform and resource directory with training, tools, and investigation management capabilities.

Google Dorks & Advanced Search Operators

Google Dorks use advanced search operators to find specific information that isn't easily discoverable through normal searches. The Google Hacking Database (GHDB) contains thousands of example dorks:

// Common Google Dork Operators with Examples site:example.com → Search only within a specific domain or subdomain site:example.com -www → Exclude subdomains containing "www" intitle:"index of" → Find open directory listings (potential file exposure) intitle:"parent directory" → Alternative directory listing search filetype:pdf "confidential" → Find PDF files containing the word "confidential" filetype:xlsx "password" → Find Excel spreadsheets containing passwords intext:"@gmail.com" password → Find pages with Gmail addresses and the word "password" inurl:"/wp-admin" → Find WordPress admin login pages cache:example.com → View Google's cached version of a page info:example.com → Information about a page (cache, similar, links) link:example.com → Find websites that link to a specific domain related:example.com → Find similar/related websites intitle:login inurl:wp-login → Find WordPress login pages inurl:phpinfo.php → Find PHP configuration information pages ext:log → Find log files ext:sql intext:"password" → Find SQL files containing password fields "index of /" "backup" → Find backup directories "master.passwd" → Find password files

Interactive Google Dork Example Generator

Enter a search term (name, domain, company, or keyword) to see example Google Dorks. This demonstrates how advanced operators work (educational demonstration only):

Enter a search term to see example Google Dorks for OSINT research

Warning: Some Google Dorks can reveal sensitive information including passwords, exposed databases, and unsecured webcams. Use these techniques only for legitimate research, authorized penetration testing, or protecting your own assets. Never access, download, or use data without proper authorization. Violating terms of service or accessing unauthorized data may violate computer crime laws (CFAA, Computer Misuse Act).

OSINT Best Practices & Operational Security (OPSEC)

Conduct OSINT effectively, professionally, and safely with these operational security guidelines:

Professional OSINT Principle: The best OSINT investigators combine automated tools with human critical thinking. Tools provide data points and correlation; human analysis creates actionable intelligence, identifies false positives, and understands context that automated systems miss.

OSINT Ethics, Legal Frameworks & Responsible Use

Responsible OSINT practitioners follow strict ethical guidelines and comply with applicable laws. OSINT is powerful but must be used responsibly:

Legal Disclaimer & Compliance Notice

OSINT should be conducted ethically, responsibly, and in full compliance with applicable laws. In many jurisdictions:

  • Harvesting personal data for stalking, harassment, or doxxing is illegal and carries severe criminal penalties
  • Circumventing paywalls, authentication mechanisms, or access controls violates computer crime laws (CFAA, Computer Misuse Act 1990)
  • Collecting data on protected characteristics (race, religion, health status, political affiliation) may violate anti-discrimination and privacy laws
  • Using obtained information for blackmail, extortion, or threats is a serious felony in most jurisdictions
  • GDPR (EU) and CCPA (California) grant individuals rights over their personal data, including deletion and restriction of processing
  • Unauthorized access to computer systems, even via exposed data, may violate anti-hacking statutes

Important: This guide is for educational and defensive purposes to help security professionals, investigators, journalists, and privacy-conscious individuals understand OSINT methodologies for legitimate purposes including: protecting personal privacy, authorized security assessments, threat intelligence, missing person searches, fraud investigations, and academic research.

Always ensure your OSINT activities comply with local, national, and international laws. When in doubt about legality, consult with qualified legal counsel before proceeding. Unauthorized OSINT collection may result in criminal charges, civil liability, professional sanctions, and platform bans.

Ethical OSINT Pledge: Professional OSINT practitioners commit to: 1) Using open source data only, never hacking or deception, 2) Respecting privacy and human dignity, 3) Verifying findings before acting, 4) Protecting vulnerable populations, 5) Complying with all applicable laws, 6) Reporting findings responsibly, 7) Continuous learning and improvement.

Further OSINT Learning Resources

SANS SEC487: OSINT Collection & Analysis

Comprehensive OSINT certification course covering tools, techniques, methodologies, and legal considerations for professional investigators.

Bellingcat YouTube Tutorials

Free investigative methodology tutorials from professional OSINT journalists covering geolocation, image verification, and social media investigation.

Michael Bazzell OSINT Books

Comprehensive OSINT methodology books including "Open Source Intelligence Techniques" (updated annually). The industry standard reference for practitioners.

OSINT Community Forums & Discord

Connect with professional OSINT practitioners, researchers, and investigators. Share techniques, ask questions, and stay updated on new tools.

OSINT Twitter Community (#OSINT)

Active community of OSINT professionals sharing techniques, tools, case studies, and real-time investigations. Follow @OSINTtechniques, @Bellingcat, @_RyanNoonan.

OSINT Podcasts & Webinars

Podcasts including "The OSINT Curious Project", "Intel Techniques", and "Bellingcat Podcast" covering methodologies, case studies, and interviews.

Trace Labs Missing Person CTF

Participate in Capture The Flag competitions focused on finding missing persons using OSINT. Real-world practice with ethical purpose.

Coursera / Udemy OSINT Courses

Self-paced online courses covering OSINT fundamentals, tools, and investigation techniques for beginners to advanced practitioners.

← Back to Knowledge Base