Liberal Education

Web Scraping Packages

Initializing search

Liberal Education

Home
Setup
Setup
- Environments
- IDE
- Tools
  Tools
  - DevOps
    DevOps
    
    Jenkins
    
    SonarQube
    
    Harbor
  - Databases
    Databases
    
    MySQL
    
    PostgreSQL
    
    MongoDB
  - Message Queue
    Message Queue
    
    RabbitMQ
    
    Kafka
Linux
Linux
- Commands
Programming Language
Programming Language
- Python
  Python
  - Getting Started
    Getting Started
    
    Basics
    
    Syntax
    
    Keywords
    
    Comments
    
    Variables
    
    Data Types
    
    Indentation and why is it important in Python ?
  - Input/Output
    Input/Output
    
    print() function
    
    f-string
    
    Print without newline
    
    end parameter in print()
    
    sep parameter in print()
    
    Output Formatting
    
    Taking Input
    
    Taking Multiple Inputs from users
  - Data Types
    Data Types
    
    Strings
    
    Numbers
    
    Booleans
    
    Lists
    
    Tuples
    
    Sets
    
    Directory
    
    Arrays
    
    Type Casting
  - Operators
    Operators
    
    Arithmetic operators
    
    Comparison operators
    
    Logical operators
    
    Bitwise operators
    
    Assignment operators
    
    Membership & Identity operators
  - Conditional Statement
    Conditional Statement
    
    if else
    
    if statement
    
    if elif else Ladder
    
    if else on one line
    
    Ternary Condition
    
    match case statement
  - Loops
    Loops
    
    For Loop
    
    While Loop
    
    Loop Control Statement
    
    List Comprehension
    
    Dictionary Comprehension
  - Functions
    Functions
    
    Function Global and Local Scope Variables
    
    Use of pass Statement in Function
    
    Return statement
    
    range() function
    
    *args and **kwargs in Function
    
    Python closures
    
    self as Default Argument
    
    Decorators
    
    Map Function
    
    Filter Function
    
    Reduce Function
    
    Lambda Function
  - OOPs Concepts
    OOPs Concepts
    
    Classes and Objects
    
    Polymorphism
    
    Inheritance
    
    Abstract
    
    Encapsulation
    
    Iterators
  - Exception Handling
    Exception Handling
    
    File Handling
    
    Read Files
    
    Write/Create Files
    
    Exception Handling
    
    User Defined Exception
    
    Built-in Exception
    
    Try and Except
  - Packages or Libraries
    Packages or Libraries
    
    Built-in Modules
    
    Python DSA Libraries
    
    Machine Learning
    
    Python GUI Libraries
    
    Web Scraping Packages
    
    Game Development Packages
  - Collections
    Collections
    
    Counters
    
    Heapq
    
    Deque
    
    OrderedDict
    
    Defaultdict
  - Database Handling
    Database Handling
    
    Python and MongoDB
    
    Python and MySQL
- Java
  Java
  - Overview
- Kotlin
  Kotlin
  - Overview
- Scala
  Scala
  - Overview
- Gleam
  Gleam
  - Overview
- JavaScript
  JavaScript
  - Overview
- TypeScript
  TypeScript
  - Getting Started
    Getting Started
    
    What is Typescript ?
    
    Typescript Setup
    
    Typescript "Hello World !"
    
    Why Typescript ?
  - Basic Types
    Basic Types
    
    Typescript Types
    
    Type Annotations
    
    Type Inference
    
    Number Type
    
    String Type
    
    Boolean Type
    
    Object Type
    
    Array Type
    
    Tuple Type
    
    Enum Type
    
    Any Type
    
    Void Type
    
    Unknown Type
    
    Union Type
    
    String Literal Type
    
    Type Aliases
    
    Never Type
  - Control Flow Statements
    Control Flow Statements
    
    if...else
    
    switch...case
    
    for
    
    while
    
    do...while
    
    break
    
    continue
  - Functions
    Functions
    
    Functions
    
    Function Types
    
    Optional Parameters
    
    Default Parameters
    
    Rest Parameters
    
    Function Overloading
  - Classes
    Classes
    
    Classes
    
    Access Modifiers
    
    Readonly Properties
    
    Getter and Setter
    
    Inheritances
    
    Static Methods and Properties
    
    Abstract Classes
  - Interfaces
    Interfaces
    
    Interfaces
    
    Extending Interfaces
    
    Interfaces vs Abstract Classes
  - Advanced Types
    Advanced Types
    
    Intersection Types
    
    Type Guards
    
    Type Assertions
  - Generics
    Generics
    
    Typescript Generics
    
    Generic Constraints
    
    Generic Interfaces
    
    Generic Classes
- Go
  Go
  - Overview
- Rust
  Rust
  - Overview
- C
  C
  - Overview
- C++
  C++
  - Overview
- C#
  C#
  - Overview
    Overview
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
  - Fundamentals
    Fundamentals
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
    
    None
  - Important Keywords
  - Control Statements
  - OOP Concepts
  - Methods
  - Delegates
  - Constructors
  - Arrays
  - ArrayList
  - String
  - Tuple
  - ValueTuple
  - Indexers & Properties
  - Inheritance
  - Interfaces
  - Multithreading
  - Exception Handling
  - Collections & Generics
  - Collections Namespace
  - Generic Namespace
  - System Namespace
  - Specialized Namespace
  - What's New in C# 8.0
  - Windows Forms
- PHP
  PHP
  - Overview
Database
Database
- SQL
  SQL
  - SQL Basics
    SQL Basics
    
    What is a Database ?
    
    Types of Databases
    
    What is DBMS ?
    
    Relational and Non Relational Databases
    
    What is SQL ?
    
    SQL Data Types
    
    SQL Operators
    
    SQL Commands
  - Create Database in SQL
    Create Database in SQL
    
    SQL CREATE Database
    
    SQL DROP Database
    
    SQL RENAME Database
    
    SQL SELECT Database
  - Tables in SQL
    Tables in SQL
    
    SQL CREATE TABLE
    
    SQL DROP TABLE
    
    SQL DELETE TABLE
    
    SQL RENAME TABLE
    
    SQL TRUNCATE TABLE
    
    SQL COPY TABLE
    
    SQL TEMP TABLE
    
    SQL ALTER TABLE
  - SQL Queries
    SQL Queries
    
    SQL SELECT Statement
    
    SQL SELECT TOP
    
    SQL SELECT FIRST
    
    SQL SELECT LAST
    
    SQL SELECT RANDOM
    
    SQL SELECT IN
    
    SQL SELECT DATE
    
    SQL INSERT Multiple Rows
    
    SQL INSERT INTO
    
    SQL UPDATE Statement
    
    SQL DELETE Statement
    
    SQL DELETE Duplicate Rows
  - SQL Clauses
    SQL Clauses
    
    SQL WHERE Clause
    
    SQL WITH Clause
    
    SQL HAVING Clause
    
    SQL ORDER BY Clause
    
    SQL GROUP BY Clause
    
    SQL LIMIT Clause
  - SQL Operators
    SQL Operators
    
    SQL AND Operator
    
    SQL OR Operator
    
    SQL LIKE Operator
    
    SQL IN Operator
    
    SQL NOT Operator
    
    SQL NOT EQUAL Operator
    
    SQL IS NULL Operator
    
    SQL UNION Operator
    
    SQL UNION ALL Operator
    
    SQL EXCEPT Operator
    
    SQL BETWEEN Operator
    
    SQL ALL Operator
    
    SQL ANY Operator
    
    SQL INTERSECT Operator
    
    SQL EXISTS Operator
    
    SQL CASE Operator
  - SQL Aggregate Functions
    SQL Aggregate Functions
    
    SQL Aggregate Function
    
    SQL Count() Function
    
    SQL SUM() Function
    
    SQL MIN() Function
    
    SQL MAX() Function
    
    SQL AVG() Function
  - SQL Data Constraints
    SQL Data Constraints
    
    SQL NOT NULL Constraints
    
    SQL UNIQUE Constraints
    
    SQL PRIMARY KEY Constraints
    
    SQL FOREIGN KEY Constraints
    
    SQL Composite Key
    
    SQL Unique Constraints
    
    SQL Alternate Key
    
    SQL CHECK Constraints
    
    SQL DEFAULT Constraints
  - SQL Joining Data
    SQL Joining Data
    
    SQL JOIN
    
    SQL OUTER JOIN
    
    SQL LEFT JOIN
    
    SQL RIGHT JOIN
    
    SQL FULL JOIN
    
    SQL CROSS JOIN
    
    SQL SELF JOIN
    
    SQL UPDATE With JOIN
    
    SQL DELETE JOIN
    
    SQL RECURSIVE JOIN
  - SQL Functions
    SQL Functions
    
    Date Functions in SQL
    
    String Functions in SQL
    
    Numeric Functions in SQL
    
    Statistical Functions in SQL
    
    JSON Functions in SQL
    
    Conversion Functions in SQL
    
    Datatype Functions in SQL
    
    LTRIM Function in SQL
    
    UPPER Function in SQL
    
    RTRIM Function in SQL
  - SQL Views
    SQL Views
    
    SQL CREATE VIEW
    
    SQL UPDATE VIEW
    
    SQL DELETE VIEW
  - SQL Indexes
    SQL Indexes
    
    SQL Indexes
    
    SQL Create Index
    
    SQL Drop Index
    
    SQL Clustered Index vs Non-Clustered Index
  - SQL Miscellaneous Topics
    SQL Miscellaneous Topics
    
    SQL Wildcards Operators
    
    SQL Comments
    
    SQL Pivot and Unpivot
    
    SQL Injection
    
    SQL Performance Tuning
    
    SQL Stored Procedures
    
    SQL Transactions
    
    SQL Sub Queries
    
    SQL Using Sequences
    
    SQL Auto Increment
    
    SQL Window Functions
    
    SQL Date & Time
    
    SQL Cursors
    
    SQL Common Table Expressions
    
    SQL Dynamic SQL
- NoSQL
Git
Automation Testing
Automation Testing
- Overview
- Selenium
  Selenium
  - Overview
- PyTest
  PyTest
  - Overview
- Unittest
  Unittest
  - Overview
- Robot Framework
  Robot Framework
  - Overview
  - Getting started
    Getting started
    
    Introduction
    
    Installation instructions
  - Creating test data
    Creating test data
    
    Test data syntax
    
    Creating test cases
    
    Creating tasks
    
    Creating test suites
    
    Using test libraries
    
    Variables
    
    Creating user keywords
    
    Resource and variable files
    
    Control structures
    
    Advanced features
  - Executing test cases
    Executing test cases
    
    Basic usage
    
    Test execution
    
    Task execution
    
    Post-processing outputs
    
    Configuring execution
    
    Output files
  - Extending Robot Framework
    Extending Robot Framework
    
    Creating test libraries
    
    Remote library interface
    
    Listener interface
    
    Parser interface
  - Supporting Tools
    Supporting Tools
    
    Library documentation tool (Libdoc)
    
    Test data documentation tool (Testdoc)
    
    Test data clean-up tool (Tidy)
    
    External tools
- Behave
  Behave
  - Overview
- Locust
  Locust
  - Overview
- Postman & Newman
  Postman & Newman
  - Overview
- Requests & PyTest
  Requests & PyTest
  - Overview
- Appium
  Appium
  - Overview
- JMeter
  JMeter
  - Overview
- Allure
  Allure
  - Overview
- PyAutoGUI
  PyAutoGUI
  - Overview
Frontend
Frontend
- React
- Vue
- Angular
- Next
- Svelte
- Preact
Backend
Backend
- JavaScript
  JavaScript
  - ExpressJS
- TypeScript
  TypeScript
  - NestJS
- Java
  Java
  - Spring Boot
- Python
  Python
  - FastAPI
  - Flask
- Go
- Rust
- PHP
  PHP
  - Laravel
- C#
Data Science
AI-ML-DL
AI-ML-DL
IoT
DevOps
DevOps
- Docker
  Docker
  - Introduction
    Introduction
    
    Introduction to Docker
    
    Features of Docker
    
    Docker Architecture
    
    Docker Hub
    
    Docker Cloud
  - Docker Installation
    Docker Installation
    
    Docker Installation on Windows
    
    Docker Installation on Windows using Chocolatey
    
    Docker Installation on Ubuntu
    
    Docker Installation on MacOS
    
    Docker Installation on Arch-based Linux
    
    Docker Installation on RedHat
  - Docker Commands
    Docker Commands
    
    Docker Instructions
    
    Run Commands Inside Containers
    
    USER Instruction
  - Docker Run
    Docker Run
    
    Dockerfile
    
    Syntax of Dockerfile
    
    How to Build a Web Server Docker File ?
  - Docker Images
    Docker Images
    
    Docker Images
    
    Working with Images
    
    Publish Docker Images in Hub
    
    Create a Customized Image
    
    Use Image Tags
    
    How to use Next.js Image
    
    How to use Local Image with Minikube
  - Docker Compose
    Docker Compose
    
    Introduction to Docker Compose
    
    Compose tools to run Multi Container Apps
  - Docker Engine, Storage
    Docker Engine, Storage
    
    Docker Storage
    
    Backup Docker Container
    
    Manage Volumes using CLI
  - Docker Networking
    Docker Networking
    
    Docker Networking
    
    Docker Ports
    
    Creating a Network and connecting a Container
    
    Connecting Two Docker Containers Over the Same Network
    
    Default Bridge Networking
    
    Create your own secure Home Network using Pi-hole and Docker
  - Docker Registry
    Docker Registry
    
    Docker Registry
    
    Docker - Public Repositories
    
    Docker - Private Registries
  - Docker Containers and Managing Containers
    Docker Containers and Managing Containers
    
    Containerization using Docker
    
    Docker Container Virtualization
    
    Docker Container for Node.js
    
    Remove Containers
    
    Push a Container Image to a Docker Repository
    
    Docker Container Linking
    
    Manage Containers using CLI
    
    Mount Volume inside Container
    
    Difference between Images and Containers
    
    Difference between Virtual Machines and Containers
    
    How to Install Linux Package in Docker Container
    
    Copying Files to and from Docker Containers
    
    Run MongoDB as Container
    
    Container for Node.js
    
    Container for NGINX
    
    How to Provide the Static IP to a Docker Container ?
  - Docker Swarm
    Docker Swarm
    
    Introduction to Docker Swarm
    
    Difference between Kubernetes and Docker Swam
  - Miscellaneous
    Miscellaneous
    
    Running a Java Application using Docker
    
    Running a PHP Application using Docker
    
    Running a Python Application using Docker
    
    How to Dockerize an ExpressJS App ?
    
    How to Dockerize an ReactJS App ?
    
    Docker Vs Kubernetes
    
    Deploying WebApps on Docker
    
    Docker Continuous Integration
    
    Difference Between Vagrant and Docker
    
    How to Setup Jenkins in Docker Container ?
- Kubernetes
  Kubernetes
  - Basics of Kubernetes
    Basics of Kubernetes
    
    Introduction to Kubernetes
    
    Installation Methods
    
    Installation of Kubernetes on Ubuntu
    
    Architecture
    
    Monolithic Architecture of Kubernetes
    
    Kubernetes vs Docker
    
    Concept of Containers
    
    Introduction to Container Orchestration
    
    Images
    
    Jobs
    
    Labels & Selectors
    
    Namespace
    
    Node
    
    Node Port Service
    
    Cluster IP vs Node-Port
    
    Service
    
    Service DNS
    
    Pod
    
    Run a Command in Pod's Containers
    
    Create Multiple Container in a Pod
    
    Replication Controller
    
    Difference Between Replicaset and Replication Controller
    
    Deployments
    
    Volumes
    
    Secrets
    
    Working with Secrets
    
    How to set up a Kubernetes cluster on a local machine using minikube ?
    
    Physical Servers vs Virtual Machines Vs Containers
  - Advanced of Kubernetes
    Advanced of Kubernetes
    
    API
    
    Taint and Toleration
    
    Kubectl
    
    Kubectl Commands
    
    Kubectl Delete
    
    Load Balancing Service
    
    Kubectl Create and Kubectl Apply
    
    ConfigMap
    
    Create Config Map from Files
    
    Create Config Map from YAML
    
    Create Config Map from Directories
    
    Injecting Config Map as Files
    
    Injecting Config Map in Pods
    
    Kubernetes Resource Model (KRM) and How to make Use of YAML ?
    
    Installing Private Git Server on K8s Cluster with Gitea and AKS
    
    Enable Remote Debugging For Java Application Deployed in Kubernetes Environment
    
    How to Enable JMX For Java Application Running in the Kubernetes Cluster ?
- Jenkins
  Jenkins
- Ansible
- Terraform
- Vagrant
Design Pattern
Message Queue
Message Queue
- RabbitMQ
- Kafka
Microservices
Code Examples
Code Examples
- Search Tools
  Search Tools
  - Meilisearch
    Meilisearch
    
    Node.js and MongoDB
Homelab
Homelab
- Tools
  Tools
  - Security & Authentication
    Security & Authentication
    
    Authentik
    
    Keycloak
  - File Management & Sharing
    File Management & Sharing
    
    Chibisafe
    
    Filebrowser
    
    Matrix
    
    Nextcloud
    
    PingVin
    
    Syncthing
  - Backup & Sync
    Backup & Sync
    
    Duplicati
    
    Pairdrop
  - Note Talking & Collaboration
    Note Talking & Collaboration
    
    Excalidraw
    
    Focalboard
    
    Joplin
    
    Mealie
    
    Memos
  - Media & Streaming
    Media & Streaming
    
    Jellyfin
    
    Logitech Media Server
    
    Photoprism
  - Productivity & Organization
    Productivity & Organization
    
    Homepage
    
    IT Tools
    
    Linkstack
    
    Paperless
    
    PrivateBin
    
    MkDocs
    
    FreshRSS
    
    Wallos
  - Monitoring & Management
    Monitoring & Management
    
    Beszel
    
    cAdvisor
    
    Grafana
    
    Loki and Promtail
    
    Nexterm
    
    Nginx Proxy Manager
    
    Ntfy
    
    Prometheus
    
    Speedtest Tracker
    
    Traefik
    
    Uptime Kuma
    
    Watchtower
  - Docker Management & Deployment
    Docker Management & Deployment
    
    Cosmos Cloud
    
    Dockge
    
    Portainer
- Network

Web Scraping Packages

Made with Material for MkDocs