{"id":268,"title":"Collecting Web Data","url":"https://intersect.org.au/training/course/webdata201","description":"Web scraping is a technique for extracting information from websites. This can be done manually but it is usually faster, more efficient and less error-prone if it can be automated.  \n  \n Web scraping allows you to convert non-tabular or poorly structured data into a usable, structured format, such as a .csv file or spreadsheet. But scraping is about more than just acquiring data: it can help you track changes to data online, and help you archive data. In short, it’s a skill worth learning.  \n  \n So join us for this web scraping workshop to learn web scraping, using the researcher-focused training modules from the highly regarded Software Carpentry Foundation.\n\nThe concept of structured data  \n The use of XPath queries on HTML document  \n How to scrape data using browser extensions  \n How to scrape using Python and Scrapy  \n How to automate the scraping of multiple web pages\n\nA good knowledge of the basic concepts and techniques in Python. Consider taking our \\Learn to Program: Python\\ and \\Python for Research\\ courses to come up to speed beforehand.","doi":null,"licence":"CC-BY-4.0","contact":"training@intersect.org.au","keywords":["Python"],"remote_updated_date":null,"remote_created_date":null,"created_at":"2022-06-07T05:14:39.701Z","updated_at":"2024-11-20T14:01:04.412Z","content_provider_id":5,"target_audience":[],"authors":["Intersect Australia"],"contributors":[],"subsets":[],"resource_type":[],"other_types":null,"version":null,"status":"active","date_created":null,"date_modified":null,"date_published":null,"prerequisites":null,"syllabus":null,"learning_objectives":null,"fields":[],"scientific_topics":[],"operations":[]}