top of page

Using Beautiful Soup to Gather Housing Data.

  • Jason Ismail
  • Apr 3, 2021
  • 1 min read

Updated: May 24, 2021

Here is a my notebook for this project:


For this project I used Requests and Beautiful Soup to gather data off of a website then I cleaned it and stored it in a database so I could use it later.





The data was gathered from https://www.greybeardrealty.com/


The goal was to find homes in Asheville NC near lake lure.


Here is an example listing:


I noticed that I could change their URL to include up to 750 listings by editing &r=1-750& in the following url. (Do note opening this directly may lag the website)


“Altering the URL allowed me to gather quite a bit of information off their website.”

I viewed the source code for the website and gathered some intel on where the data was stored.


I loaded the first record and started to work with it. Using what I learned I started to find the information that I needed.



Which produced the results I was looking for.



“I looped through my results and built my database.”

Before:

Of course the data needed to be cleaned up a bit. For instance sq_feet was text data that needed to be separated and formatted.


After:


Now my data was ready to work with.

Komentáře


Komentování u tohoto příspěvku již není k dispozici. Pro více informací kontaktujte vlastníka webu.

DON'T MISS THE FUN.

Thanks for submitting!

Looking to Hire?

Connect with a Versatile Data Scientist

 

 


Are you in need of tailored data science solutions for your business? I'm here to help. With a Master's Degree in Data Science and a Bachelor's in Mathematics, I bring a blend of academic rigor and practical experience to the table.

Expertise in Building Comprehensive Data Solutions:

Proficient in developing end-to-end data science projects, including the collection, cleaning, and analysis of raw data.
Specialized in Python.


Technical Proficiencies:

Skilled in using Pandas, Yolo, NumPy, PyTorch and Keras/TensorFlow for creating sophisticated Deep Neural Networks.
Experienced in computer vision and leveraging Nvidia CUDA for high-performance computing tasks.


Personal Qualities:

Recognized by peers, mentors, and students as a dedicated and hardworking professional. I come with a long list of references.


Known for facing challenges head-on and being a supportive team player.
Skilled at making complex concepts accessible and relatable, with a passion for continuous learning.


Contact Information:

Jason Ismail
Masters in Data Science, Bachelors in Mathematics
LinkedIn Profile
Phone (Text Only): 719-322-8479

About Me

Data Science

Data Science isn't just my career; it's the realization of a lifelong passion where my love for mathematics, programming, and technology converge. Over the past 20 years, I've nurtured a deep fondness for computers, starting from building them to exploring their immense capabilities.

My academic path initially led me to programming and then chemistry, where I excelled nationally in the 98th percentile. This experience, however, led to an epiphany - it was the mathematical elements within chemistry that truly captivated me. This revelation steered me towards a scholarship in Mathematics and a subsequent career in teaching.

But the true calling came with Data Science. Here, I found an exhilarating opportunity to transform abstract mathematical theories into impactful, real-world applications. My focus now is on cutting-edge areas such as Artificial Intelligence, Neural Networks, Computer Vision, and Reinforcement Learning - fields where I can blend my analytical skills with creative problem-solving to innovate and advance the boundaries of technology.

Data Science for me is more than a profession; it's a canvas where I paint with numbers and algorithms, creating solutions that matter.

POST ARCHIVE

bottom of page