Dataset Viewer
Auto-converted to Parquet Duplicate
messages
listlengths
3
6
[ { "role": "user", "content": "Write unit tests for the calculator.py module." }, { "role": "assistant", "content": "I will create a test file with comprehensive test cases." }, { "role": "assistant", "content": "All 5 tests pass. The test file covers addition, subtraction, multiplica...
[ { "role": "user", "content": "Install the requests library in this environment." }, { "role": "assistant", "content": "I will install the requests package using pip." }, { "role": "assistant", "content": "Requests is now installed. Version 2.31.0." }, { "role": "user", "c...
[ { "role": "user", "content": "Set up a Python virtual environment for this project." }, { "role": "assistant", "content": "I will create a venv and install the required dependencies." }, { "role": "assistant", "content": "Virtual environment is set up with numpy and pandas installed....
[ { "role": "user", "content": "Commit all the changes in the current directory with a descriptive message." }, { "role": "assistant", "content": "I will check the git status, stage the files, and commit them." }, { "role": "assistant", "content": "Changes committed successfully. The c...
[ { "role": "user", "content": "Find all Python files in /workspace that contain the word TODO." }, { "role": "assistant", "content": "I will search for Python files with TODO comments using ripgrep." }, { "role": "assistant", "content": "Found 8 files with TODO comments. They are: mai...
[ { "role": "user", "content": "Check the disk usage of /workspace and show the top 5 largest files." }, { "role": "assistant", "content": "I will check disk usage and find the largest files." }, { "role": "assistant", "content": "Disk usage: 65 percent used (130G of 200G). Top 5 large...
[ { "role": "user", "content": "Count the total lines of code in this project, excluding tests and vendor directories." }, { "role": "assistant", "content": "I will use cloc to get a detailed breakdown." }, { "role": "assistant", "content": "Project stats: 12500 lines of code across Py...
[ { "role": "user", "content": "Rename all .txt files in /workspace/notes to have a date prefix from today." }, { "role": "assistant", "content": "I will get today's date and rename the files with the prefix." }, { "role": "assistant", "content": "All 7 files renamed with the 2024-09-0...
[ { "role": "user", "content": "Create a directory structure for a new project with src, tests, docs, and config folders." }, { "role": "assistant", "content": "I will create the project structure with appropriate subfolders." }, { "role": "assistant", "content": "Project structure cre...
[ { "role": "user", "content": "Analyze the app.log file and count errors by type." }, { "role": "assistant", "content": "I will read the log file and count error patterns." }, { "role": "assistant", "content": "Error counts: ConnectionError 45, TimeoutError 32, ValueError 18, KeyError...
[ { "role": "user", "content": "Test the API endpoint at /api/users and verify it returns a list with at least 10 users." }, { "role": "assistant", "content": "I will use curl to test the endpoint and check the response." }, { "role": "assistant", "content": "API returned 25 users. The...
[ { "role": "user", "content": "Create a Dockerfile for a Python Flask app." }, { "role": "assistant", "content": "I will create an optimized Dockerfile with multi-stage build." }, { "role": "assistant", "content": "Dockerfile created with multi-stage build to keep image size small. Th...
[ { "role": "user", "content": "Query the users database to find the top 5 users by order count." }, { "role": "assistant", "content": "I will connect to the database and run the query." }, { "role": "assistant", "content": "Top 5 users: Alice with 25 orders, Bob with 22, Charlie with ...
[ { "role": "user", "content": "Convert the users.json file to CSV format." }, { "role": "assistant", "content": "I will read the JSON and convert it to CSV using Python." }, { "role": "assistant", "content": "JSON converted to CSV. The output has headers and 50 rows of user data." }...
[ { "role": "user", "content": "Create a backup of all important config files with timestamps." }, { "role": "assistant", "content": "I will create a backup directory and copy files with timestamps." }, { "role": "assistant", "content": "All config files backed up to /workspace/backups...
[ { "role": "user", "content": "Make the deploy.sh script executable and verify the permissions." }, { "role": "assistant", "content": "I will change the file mode to executable and check the result." }, { "role": "assistant", "content": "Permissions updated. The script now has execute...
[ { "role": "user", "content": "Check if the web server process is running and show its resource usage." }, { "role": "assistant", "content": "I will find the process and check its stats." }, { "role": "assistant", "content": "Process found. PID 1234, using 8.2 percent CPU and 256MB me...
[ { "role": "user", "content": "Show me the size of every file in the current directory sorted by size." }, { "role": "assistant", "content": "I will list files with their sizes in human readable format." }, { "role": "assistant", "content": "Largest to smallest: model.bin 2.3G, datase...
[ { "role": "user", "content": "Create a .env file template for the project with all required variables." }, { "role": "assistant", "content": "I will create a comprehensive .env template." }, { "role": "assistant", "content": "Env template created with database, API, server, cache, an...
[ { "role": "user", "content": "Find all usages of the deprecated old_function in the codebase." }, { "role": "assistant", "content": "I will search the entire codebase for old_function references." }, { "role": "assistant", "content": "Found 12 usages in 5 files: api.py (3), main.py (...
[ { "role": "user", "content": "Check the network configuration and current IP addresses." }, { "role": "assistant", "content": "I will run several commands to gather network info." }, { "role": "assistant", "content": "Local IPs: 192.168.1.100 on eth0, 10.0.0.5 on docker0. Public IP: ...
[ { "role": "user", "content": "Check the current memory usage and swap status." }, { "role": "assistant", "content": "I will check memory and swap." }, { "role": "assistant", "content": "Memory: 16GB total, 8.2GB used (51 percent), 7.8GB free. Swap: 4GB total, 0 used." } ]
[ { "role": "user", "content": "Run the test suite and show the summary." }, { "role": "assistant", "content": "I will run pytest with verbose output." }, { "role": "assistant", "content": "Test results: 45 passed, 2 failed, 1 skipped in 8.2 seconds. Failures are in test_user.py and te...
[ { "role": "user", "content": "Find all Markdown files that contain the word 'deprecated'." }, { "role": "assistant", "content": "I will search for the word in markdown files." }, { "role": "assistant", "content": "Found 3 markdown files: api.md, auth.md, payment.md." } ]
[ { "role": "user", "content": "Check if the PostgreSQL service is running." }, { "role": "assistant", "content": "I will check the service status." }, { "role": "assistant", "content": "PostgreSQL is active and running. Started 2 hours ago. Main PID 1234." } ]
[ { "role": "user", "content": "Show me the Python version and installed packages." }, { "role": "assistant", "content": "I will get the Python version and list installed packages." }, { "role": "assistant", "content": "Python 3.11.2. Top installed: pip 23.0, setuptools 65.5, requests ...
[ { "role": "user", "content": "List all environment variables that contain the word 'PATH'." }, { "role": "assistant", "content": "I will filter environment variables." }, { "role": "assistant", "content": "PATH=/usr/local/bin:/usr/bin:/bin, PYTHONPATH=/workspace, GOPATH=/home/user/go...
[ { "role": "user", "content": "Count how many files are in /workspace and break it down by type." }, { "role": "assistant", "content": "I will count files by extension." }, { "role": "assistant", "content": "File breakdown: py 145, json 23, md 18, txt 12, csv 8, yml 6, sh 4, other 15....
[ { "role": "user", "content": "Clean up all .pyc files and __pycache__ directories from the project." }, { "role": "assistant", "content": "I will find and remove all compiled Python files." }, { "role": "assistant", "content": "All .pyc files and __pycache__ directories removed. Save...
[ { "role": "user", "content": "Set up a cron job to run a backup script every day at 2am." }, { "role": "assistant", "content": "I will add a cron entry to the crontab." }, { "role": "assistant", "content": "Cron job installed. The backup script will run at 2am daily and log output." ...
[ { "role": "user", "content": "Extract all email addresses from the contacts.txt file." }, { "role": "assistant", "content": "I will use a regex to find email patterns." }, { "role": "assistant", "content": "Found 15 unique email addresses including alice@example.com, bob@company.org,...
[ { "role": "user", "content": "Check if the website example.com is up and what its response time is." }, { "role": "assistant", "content": "I will use curl to check the response." }, { "role": "assistant", "content": "Status 200 OK, response time 0.234 seconds. The site is up and resp...
[ { "role": "user", "content": "Generate 5 unique UUIDs for new user accounts." }, { "role": "assistant", "content": "I will use Python uuid module to generate them." }, { "role": "assistant", "content": "5 UUIDs generated: 5f8d3e1a-..., 7c2b9f4d-..., 9e1a8b6c-..., 3d4e5f6a-..., 8b9c0d...
[ { "role": "user", "content": "Get the current Unix timestamp in seconds and milliseconds." }, { "role": "assistant", "content": "I will get the current time in multiple formats." }, { "role": "assistant", "content": "Seconds: 1725782400. Milliseconds: 1725782400123." } ]
[ { "role": "user", "content": "Compute the SHA256 hash of the data.bin file." }, { "role": "assistant", "content": "I will use sha256sum to compute the hash." }, { "role": "assistant", "content": "SHA256: a3f5b9c8d2e1f4a7b6c5d8e9f1a2b3c4d5e6f7a8b9c0d1e2f3a4b5c6d7e8f9a0." } ]
[ { "role": "user", "content": "Check which ports are currently in use on this machine." }, { "role": "assistant", "content": "I will list listening ports." }, { "role": "assistant", "content": "Listening ports: 22 (SSH), 80 (HTTP), 443 (HTTPS), 3306 (MySQL), 5432 (PostgreSQL), 6379 (R...
[ { "role": "user", "content": "Create a tar.gz archive of the /workspace/project folder." }, { "role": "assistant", "content": "I will create a compressed archive." }, { "role": "assistant", "content": "Archive created: project_20240908.tar.gz, size 45MB." } ]
[ { "role": "user", "content": "Extract the archive.tar.gz file to /workspace/extracted." }, { "role": "assistant", "content": "I will create the destination and extract." }, { "role": "assistant", "content": "Archive extracted. 12 files and 3 directories are now in /workspace/extracte...
[ { "role": "user", "content": "Extract all user names from the data.json file using jq." }, { "role": "assistant", "content": "I will use jq to query the JSON." }, { "role": "assistant", "content": "Extracted 25 user names: Alice, Bob, Charlie, Diana, Eve, Frank, Grace, Henry, Ivy, Ja...
[ { "role": "user", "content": "Test the download speed from the server." }, { "role": "assistant", "content": "I will use a test file to measure speed." }, { "role": "assistant", "content": "Download speed: 12.5 MB/s from Cloudflare test. That is about 100 Mbps." } ]
[ { "role": "user", "content": "Install the lodash package via npm." }, { "role": "assistant", "content": "I will install lodash in the project." }, { "role": "assistant", "content": "Lodash installed. The package is in node_modules and package.json is updated." } ]
[ { "role": "user", "content": "Check the syntax of all Python files in this project." }, { "role": "assistant", "content": "I will compile each Python file to check for syntax errors." }, { "role": "assistant", "content": "All 45 Python files compiled without syntax errors. The projec...
[ { "role": "user", "content": "Format all Python files using black." }, { "role": "assistant", "content": "I will run black on the project." }, { "role": "assistant", "content": "Reformatted 12 files. 8 files were already formatted. 4 files had changes applied." } ]
[ { "role": "user", "content": "Run pylint on the main.py file and show the issues." }, { "role": "assistant", "content": "I will run pylint and analyze the output." }, { "role": "assistant", "content": "Pylint score: 7.5/10. Issues: 3 unused imports, 2 missing docstrings, 1 line too l...
[ { "role": "user", "content": "Show me the git diff of all uncommitted changes." }, { "role": "assistant", "content": "I will run git diff to show pending changes." }, { "role": "assistant", "content": "Changes are in main.py and config.json. main.py has 15 added lines for a new funct...
[ { "role": "user", "content": "Show me the last 10 commits in a nice format." }, { "role": "assistant", "content": "I will show the recent commits with a pretty format." }, { "role": "assistant", "content": "Last 10 commits shown. Includes feature additions, bug fixes, and refactors. ...
[ { "role": "user", "content": "Create a new branch called feature/user-auth and switch to it." }, { "role": "assistant", "content": "I will create the branch and switch to it." }, { "role": "assistant", "content": "Branch created and switched. Now on feature/user-auth. Other branches ...
[ { "role": "user", "content": "Find duplicate email addresses in the customers.csv file." }, { "role": "assistant", "content": "I will use Python to find duplicates." }, { "role": "assistant", "content": "Found 5 duplicate emails. The most common duplicate is test@example.com appearin...
[ { "role": "user", "content": "Convert all PNG files in /workspace/images to JPG format." }, { "role": "assistant", "content": "I will use ImageMagick to convert the files." }, { "role": "assistant", "content": "Converted 12 PNG files to JPG. Original PNGs are preserved." } ]
[ { "role": "user", "content": "Benchmark the sort function in sort.py with 1 million items." }, { "role": "assistant", "content": "I will write a benchmark script and run it." }, { "role": "assistant", "content": "Sorted 1 million items in 2.34 seconds. The quicksort implementation is...
[ { "role": "user", "content": "Read the contents of /workspace/report.docx and tell me the structure." }, { "role": "assistant", "content": "I will use python-docx to extract the content." }, { "role": "assistant", "content": "The document has 25 paragraphs: 1 title, 5 headings, 15 bo...
[ { "role": "user", "content": "Create a new Word document with a title, introduction, and 3 sections." }, { "role": "assistant", "content": "I will use python-docx to create the document." }, { "role": "assistant", "content": "Document created with title and 3 sections. The file is 38...
[ { "role": "user", "content": "Update the title in report.docx from 'Old Title' to 'Q4 2024 Report'." }, { "role": "assistant", "content": "I will modify the title using python-docx." }, { "role": "assistant", "content": "Title updated. The document now has 'Q4 2024 Report' as the mai...
[ { "role": "user", "content": "Extract text from the first 3 pages of manual.pdf." }, { "role": "assistant", "content": "I will use pypdf to extract the text." }, { "role": "assistant", "content": "First 3 pages cover: 1) Title and intro, 2) Installation steps, 3) Configuration option...
[ { "role": "user", "content": "Merge report1.pdf and report2.pdf into combined.pdf." }, { "role": "assistant", "content": "I will use pypdf to merge the documents." }, { "role": "assistant", "content": "PDFs merged. combined.pdf has 15 pages total (8 from report1, 7 from report2)." ...
[ { "role": "user", "content": "Split big.pdf into individual pages saved as page_N.pdf." }, { "role": "assistant", "content": "I will split the PDF into single pages." }, { "role": "assistant", "content": "Split into 12 individual page files." } ]
[ { "role": "user", "content": "Convert invoice.pdf to a text file with all content." }, { "role": "assistant", "content": "I will extract the text and save it." }, { "role": "assistant", "content": "Text extracted and saved. The invoice text is 2,450 characters." } ]
[ { "role": "user", "content": "Create an Excel file with a sales table including headers and 5 rows of data." }, { "role": "assistant", "content": "I will use openpyxl to create the spreadsheet." }, { "role": "assistant", "content": "Excel file created with sales data. 6 rows includin...
[ { "role": "user", "content": "Read the data.xlsx file and show all values." }, { "role": "assistant", "content": "I will use openpyxl to read the file." }, { "role": "assistant", "content": "The file has 1 sheet 'Data' with 50 rows. Columns: ID, Name, Value, Date." } ]
[ { "role": "user", "content": "Add a Total column to sales.xlsx that multiplies Quantity and Price." }, { "role": "assistant", "content": "I will read the file, compute totals, and update it." }, { "role": "assistant", "content": "Total column added. The grand total is 1,715." } ]
[ { "role": "user", "content": "Create a 5-slide presentation about quarterly results." }, { "role": "assistant", "content": "I will use python-pptx to build the slides." }, { "role": "assistant", "content": "Presentation created with 5 slides: title, revenue, customers, highlights, ne...
[ { "role": "user", "content": "Convert the README.md file to HTML." }, { "role": "assistant", "content": "I will use a markdown library to convert." }, { "role": "assistant", "content": "Markdown converted to HTML. The file has 145 lines of generated content." } ]
[ { "role": "user", "content": "Convert data.csv to an Excel file with formatting." }, { "role": "assistant", "content": "I will use pandas to convert and format." }, { "role": "assistant", "content": "CSV converted to Excel with auto-sized columns. 1000 rows preserved." } ]
[ { "role": "user", "content": "Validate all JSON files in /workspace/config and report any issues." }, { "role": "assistant", "content": "I will validate each file." }, { "role": "assistant", "content": "Validated 15 files. 13 are valid, 2 have syntax errors: settings.json (trailing c...
[ { "role": "user", "content": "Convert config.yaml to JSON format." }, { "role": "assistant", "content": "I will use Python to parse YAML and output JSON." }, { "role": "assistant", "content": "YAML converted to JSON. The structure is preserved with 3 levels of nesting." } ]
[ { "role": "user", "content": "Get basic statistics on the numbers column in data.csv." }, { "role": "assistant", "content": "I will use pandas to compute statistics." }, { "role": "assistant", "content": "Stats: count 1000, mean 50.2, std 28.7, min 0, max 100, median 51. Approximatel...
[ { "role": "user", "content": "Remove duplicate rows from users.csv based on the email column." }, { "role": "assistant", "content": "I will use pandas to drop duplicates." }, { "role": "assistant", "content": "Removed 15 duplicate rows. 985 unique rows saved to users_dedup.csv." } ...
[ { "role": "user", "content": "Filter orders.csv to only include orders over $100." }, { "role": "assistant", "content": "I will filter and save the result." }, { "role": "assistant", "content": "Filtered 234 orders over $100 from 1000 total. Saved to big_orders.csv." } ]
[ { "role": "user", "content": "Group sales.csv by region and sum the amount column." }, { "role": "assistant", "content": "I will use pandas groupby." }, { "role": "assistant", "content": "Region totals: North 12500, South 8900, East 15200, West 9700. Total 46300." } ]
[ { "role": "user", "content": "Create a pivot table from sales.csv with month as rows and region as columns." }, { "role": "assistant", "content": "I will use pandas pivot_table." }, { "role": "assistant", "content": "Pivot table shows 3 months by 4 regions. East has highest sales in ...
[ { "role": "user", "content": "Merge users.csv and orders.csv on user_id." }, { "role": "assistant", "content": "I will join the two files." }, { "role": "assistant", "content": "Merged 5000 rows. Each user has all their orders or empty if no orders." } ]
[ { "role": "user", "content": "Validate data.json against the schema in schema.json." }, { "role": "assistant", "content": "I will use jsonschema to validate." }, { "role": "assistant", "content": "Validation passed. The data conforms to the schema." } ]
[ { "role": "user", "content": "Parse the config.xml file and extract all values." }, { "role": "assistant", "content": "I will use ElementTree to parse." }, { "role": "assistant", "content": "Found 8 elements: name, version, debug, port, host, db_url, secret, timeout. All extracted." ...
[ { "role": "user", "content": "Extract all links from page.html." }, { "role": "assistant", "content": "I will use BeautifulSoup to parse the HTML." }, { "role": "assistant", "content": "Found 25 links. Categories: navigation 8, content 12, footer 5." } ]
[ { "role": "user", "content": "Replace all phone numbers in text.txt with [REDACTED]." }, { "role": "assistant", "content": "I will use sed with a regex pattern." }, { "role": "assistant", "content": "Replaced 12 phone numbers. The clean file has 12 [REDACTED] markers." } ]
[ { "role": "user", "content": "Count the words and characters in essay.txt." }, { "role": "assistant", "content": "I will use wc to count." }, { "role": "assistant", "content": "Stats: 1523 words, 9234 characters, 87 lines." } ]
[ { "role": "user", "content": "Replace all instances of 'foo' with 'bar' in main.py." }, { "role": "assistant", "content": "I will use sed for the replacement." }, { "role": "assistant", "content": "Replaced 8 instances. The file now has 8 occurrences of 'bar'." } ]
[ { "role": "user", "content": "Convert file.txt from UTF-16 to UTF-8." }, { "role": "assistant", "content": "I will use iconv to convert the encoding." }, { "role": "assistant", "content": "File converted. The output is now UTF-8 encoded." } ]
[ { "role": "user", "content": "Show the differences between v1.txt and v2.txt." }, { "role": "assistant", "content": "I will use diff to compare." }, { "role": "assistant", "content": "3 differences: 2 lines added, 1 line modified. v2 has 5 extra lines." } ]
[ { "role": "user", "content": "Sort the lines in names.txt alphabetically and remove duplicates." }, { "role": "assistant", "content": "I will use sort with unique flag." }, { "role": "assistant", "content": "Sorted and deduplicated. Original 100 lines became 87 unique lines." } ]
[ { "role": "user", "content": "Count how many .py files are in the project." }, { "role": "assistant", "content": "I will use find to count." }, { "role": "assistant", "content": "There are 145 Python files in the project." } ]
[ { "role": "user", "content": "Check how much disk space is free." }, { "role": "assistant", "content": "I will check all mounted filesystems." }, { "role": "assistant", "content": "Filesystem status: root has 70GB free (35 percent used), data partition has 500GB free (25 percent used...
[ { "role": "user", "content": "Test if I can reach the database server." }, { "role": "assistant", "content": "I will ping and test port connectivity." }, { "role": "assistant", "content": "Ping succeeded. Port 5432 is open. Database is reachable." } ]
[ { "role": "user", "content": "Install Django version 4.2 specifically." }, { "role": "assistant", "content": "I will install the exact version." }, { "role": "assistant", "content": "Django 4.2 installed. Version confirmed." } ]
[ { "role": "user", "content": "Uninstall the old package called legacy-tool." }, { "role": "assistant", "content": "I will remove the package." }, { "role": "assistant", "content": "Package removed successfully." } ]
[ { "role": "user", "content": "Show me all installed Python packages." }, { "role": "assistant", "content": "I will list all packages." }, { "role": "assistant", "content": "There are 87 packages installed including numpy, pandas, requests, flask, django, and others." } ]
[ { "role": "user", "content": "Generate a requirements.txt with exact versions." }, { "role": "assistant", "content": "I will freeze the current environment." }, { "role": "assistant", "content": "Requirements file generated with exact versions. 87 packages listed." } ]
[ { "role": "user", "content": "Upgrade the requests library to the latest version." }, { "role": "assistant", "content": "I will upgrade requests." }, { "role": "assistant", "content": "Requests upgraded. Current version is 2.32.3." } ]
[ { "role": "user", "content": "Check which standard library modules are imported in main.py." }, { "role": "assistant", "content": "I will grep for import statements." }, { "role": "assistant", "content": "Imports: os, sys, json, datetime, pathlib, collections. All standard library." ...
[ { "role": "user", "content": "List all function definitions in main.py." }, { "role": "assistant", "content": "I will grep for function definitions." }, { "role": "assistant", "content": "Found 8 functions: main, helper, process_data, validate, format_output, log_error, cleanup, setu...
[ { "role": "user", "content": "List all class definitions in models.py." }, { "role": "assistant", "content": "I will search for class definitions." }, { "role": "assistant", "content": "Found 5 classes: User, Order, Product, Category, Review." } ]
[ { "role": "user", "content": "Count total lines in main.py." }, { "role": "assistant", "content": "I will use wc." }, { "role": "assistant", "content": "main.py has 234 lines." } ]
[ { "role": "user", "content": "Check if config.json exists." }, { "role": "assistant", "content": "I will check the file." }, { "role": "assistant", "content": "The file exists." } ]
[ { "role": "user", "content": "Check if the logs directory exists." }, { "role": "assistant", "content": "I will test the directory." }, { "role": "assistant", "content": "The logs directory exists." } ]
[ { "role": "user", "content": "Create a symlink from current_log to the latest log file." }, { "role": "assistant", "content": "I will find the latest log and create a symlink." }, { "role": "assistant", "content": "Symlink created. /workspace/current_log points to app.log.20240908." ...
[ { "role": "user", "content": "What type of file is /workspace/data.bin?" }, { "role": "assistant", "content": "I will use the file command." }, { "role": "assistant", "content": "data.bin: data (application/octet-stream). It is a generic binary file." } ]
[ { "role": "user", "content": "Count the characters in document.txt." }, { "role": "assistant", "content": "I will use wc with chars option." }, { "role": "assistant", "content": "The file has 12,450 characters." } ]
[ { "role": "user", "content": "Show the last 20 lines of app.log." }, { "role": "assistant", "content": "I will use tail." }, { "role": "assistant", "content": "Last 20 lines shown. Most recent activity is from 2 minutes ago." } ]
[ { "role": "user", "content": "Show the first 10 lines of app.log." }, { "role": "assistant", "content": "I will use head." }, { "role": "assistant", "content": "First 10 lines show the startup sequence and initial config load." } ]
[ { "role": "user", "content": "How many lines are in app.log?" }, { "role": "assistant", "content": "I will count the lines." }, { "role": "assistant", "content": "The log has 45,231 lines." } ]
End of preview. Expand in Data Studio

Filthy-data-SFT

This is a highly curated, cleaned, and structurally normalized version of the Arko007/Filthy-data dataset. Every file across all genres has been meticulously mapped into a standard SFT conversational sequence.

Strict Data Quality Filtering

To protect models during fine-tuning from learning corrupt or blank behaviors, we applied a strict Data Quality Pipeline:

  • No Empty Turns: Any prompt/response containing empty text strings ("") was thoroughly stripped out.
  • Coherent Conversations: Removed conversational turns with null or invalid roles.
  • Complete Conversational Loops: Dropped any thread that didn't have at least one valid user message and assistant answer.

Subsets & Genre Overview

All records in this repository are saved as high-performance Parquet files organized into subdirectory paths corresponding directly to their genres.

Genre Subset Cleaned Records Description
math_reasoning 20504 Curated mathematical problems, reasoning lines, and step-by-step logic
humour_chat 5017 Funny, witty, and contextual dialogue streams
merged_genz_chat 1190 Unified and restructured slang/colloquial GenZ and extreme filthy conversations
agent_chat 22333 System actions, structured rules, and agentic workflows

Data Schema

Every split matches this uniform, nested conversational schema:

  • messages (list of dicts):
    • role (string): Either "user" or "assistant".
    • content (string): Dialogue payload.

Sample Representation

{
  "messages": [
    {
      "role": "user",
      "content": "Yo, what is the vibe today?"
    },
    {
      "role": "assistant",
      "content": "No cap, we are just cooling out and vibing!"
    }
  ]
}

Quick Start

from datasets import load_dataset

# Load specific subsets seamlessly
agent_dataset = load_dataset("Arko007/Filthy-data-SFT", "agent_chat")
genz_dataset = load_dataset("Arko007/Filthy-data-SFT", "merged_genz_chat")

print(genz_dataset["train"][0])
Downloads last month
119