Skip to content

camphub & others campsite scraper/scraping api for python

License

Notifications You must be signed in to change notification settings

CEDT-Chula/Camphub_api_unofficial

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Usage

get an information about the camp and compettion currently available

aims to be used mainly on thailand event and compettion centered aroud tech and computer

I don't have intention to make it a scraper for commercial purpose I just want to share the information I found in discord faster

user of this project should only use it for personal use and not for commercial purpose

Supported Site

Installation

pip install camp_parser

Usage

Get CampInfro

from camp_parser import camphub_parser # or any thing thatREADME.rst we support
camp = camphub_parser('https://www.camphub.in.th/computer/') #page url
print(camp.info) #get the information

Fetch many pages at once

from camp_parser import camphub_parser # or any thing

camp = camphub_parser('https://www.camphub.in.th/computer/') # source page url default is None

data = camp.page_fetching('https://www.camphub.in.th/computer/', pages = 50) # Fetch 50 pages without MultiThreading
ndata = camp.page_fetching('https://www.camphub.in.th/computer/', pages = 50, workers = 8) # Enable Multiprocessing


#wotkers depend on your CPU core

Information structure

{
    'title': 'title of the camp',
    'link': 'link to the camp page',
    'small_description': 'mified description of the camp',
    'type': 'event type (onsite/online/etc...)',
    'organize_date': 'start date of the camp',
    'register_deadline': 'last day yu can register to the camp',
    'max_paticipants': '(string not number Ex. ไม่จำกัด, 200ค คน)',
    'costs': 'cost of the camp Ex. ฟรี, 1000 บาท',
    'paticipants_requirements': 'what you need to join the camp',
    'organizer': 'who organize the camp',
    'full_description': 'full description of the camp',

}

About

camphub & others campsite scraper/scraping api for python

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages