Skip to content

JoinDataCops/airbyte-source-datacops

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 

Repository files navigation

Source DataCops

This is the Airbyte source connector for DataCops — a fraud detection platform for web applications.

Streams

Stream Sync Mode Cursor Field Description
identified_users Full / Incremental identified_at Email-identified users with full risk signals (email risk score, disposable check, AI fake score, IP/VPN flags)
sessions Full / Incremental start_time All user sessions with bot detection, country, device, and traffic source data
bot_detections Full / Incremental detected_at Sessions flagged as bot traffic
vpn_proxy_detections Full / Incremental detected_at Sessions using VPN, proxy, or Tor

Configuration

Field Type Required Description
api_key string Private API Key (dcp_...) from DataCops dashboard → Settings → API Keys → Private Keys
base_url string API base URL (https://api.joindatacops.com)
start_date string ISO 8601 start date for initial sync (e.g. 2024-01-01T00:00:00Z)

Getting Your API Key

  1. Log into your DataCops dashboard
  2. Go to Settings → API Keys
  3. Click the Private Keys tab
  4. Click Create new key
  5. Copy the dcp_... key — it's only shown once

Use Cases

Once synced into your warehouse (Snowflake, BigQuery, Redshift, etc.):

-- Find which fraud-flagged users completed a purchase
SELECT
  u.email,
  u.email_risk_score,
  u.ai_verdict,
  u.ip_is_vpn,
  o.order_total
FROM datacops.identified_users u
JOIN your_schema.orders o ON o.user_email = u.normalized_email
WHERE u.email_risk_score > 70
  OR u.ai_verdict = 'CHALLENGE';

-- Bot traffic by country last 30 days
SELECT country, COUNT(*) as bot_count
FROM datacops.bot_detections
WHERE detected_at >= CURRENT_DATE - INTERVAL '30 days'
GROUP BY 1
ORDER BY 2 DESC;

-- VPN/Proxy users who signed up
SELECT v.ip_address, v.is_vpn, v.is_tor, u.email
FROM datacops.vpn_proxy_detections v
JOIN datacops.identified_users u ON u.session_id = v.session_id;

Local Development

# Install Airbyte CDK
pip install airbyte-cdk

# Test the connector locally
python -m airbyte_cdk.entrypoint check --config config.json
python -m airbyte_cdk.entrypoint discover --config config.json
python -m airbyte_cdk.entrypoint read --config config.json --catalog catalog.json

Example config.json:

{
  "api_key": "dcp_your_key_here",
  "base_url": "https://api.joindatacops.com",
  "start_date": "2024-01-01T00:00:00Z"
}

About

Airbyte source connector for DataCops — sync fraud detection data into any data warehouse

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors