You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
naibo c749107a6a Update MyChrome 10 months ago
..
.vscode Update MyChrome 10 months ago
undetected_chromedriver_ES Cloudflare window size 1 year ago
.gitignore macos下疯狂多开bug修复 1 year ago
Readme.md Update Readme 1 year ago
config.json Cloudflare!!! 1 year ago
easyspider_executestage.py Bug fix for links 11 months ago
easyspider_executestage_single.py V0.3.1 Official 1 year ago
favicon.ico New version 1 year ago
generateEXE_win32.cmd Win32 0.5.0 1 year ago
generateEXE_win64.cmd Change OCR to ddddocr 1 year ago
generateExecutable_Linux64.sh V0.3.1 Official 1 year ago
generateExecutable_Macos.sh Update 1 year ago
myChrome.py Update MyChrome 10 months ago
requirements.txt Bump pillow from 9.4.0 to 10.0.1 in /ExecuteStage 11 months ago
test.py XPath bug fix 1 year ago
test.xlsx 执行阶段可自动读取设置好的Excel文件作为输入字段参数值 1 year ago
utils.py 可选是否生成新行以解决多行问题 1 year ago

Readme.md

环境编译说明|Environment Compilation Instruction

EasySpider分三部分:

  1. 主程序:在ElectronJS文件夹下。
  2. 浏览器扩展:在Extension文件夹下,为浏览器的“操作台”的代码。
  3. 执行阶段程序:在ExecuteStage文件夹下。

此部分为执行阶段程序的编译说明。


EasySpider is divided into three parts:

  1. Main program: Located in the ElectronJS folder.
  2. Browser extension: Located in the Extension folder.
  3. Execution stage program: Located in the ExecuteStage folder.

This section covers the compilation instructions for the Execution stage program.

建议编译顺序|Suggested Compilation Order

  1. 编译浏览器扩展,否则在主程序执行时会提示找不到EasySpider_zh.crx的错误。
  2. 编译主程序,此时主程序可以正常运行,但无法执行任务,只能设计任务。
  3. 编译执行阶段程序,否则无法执行程序,只能设计程序。

  1. Compile the browser extension, otherwise an error will be prompted when the main program is executed that EasySpider_en.crx cannot be found.
  2. Compile the main program, at this time the main program can run normally, but can not execute the task, can only design the task.
  3. Compile the execution stage program, otherwise the program cannot be executed, can only design the program.

环境构建|Environment Setup

  1. 安装Python 3.7及以上版本并添加至系统环境变量:https://www.python.org/downloads/

  2. 安装pip3并添加至系统环境变量(Windows安装python后会自带pip,Linux和MacOS安装方式请自行搜索)。

  3. 安装执行阶段需要的依赖库:

     pip3 install -r requirements.txt
    

  1. Install Python 3.7 or higher version and add it to the system environment variables: https://www.python.org/downloads/.

  2. Install pip3 and add it to the system environment variables. (On Windows, pip is automatically installed with Python. For Linux and macOS, please refer to the appropriate installation instructions).

  3. Install the required dependencies for the execution stage by running:

    pip3 install -r requirements.txt
    

运行说明|Run Instruction

运行程序前,确保已经完成了ElectronJS文件夹下主程序的编译,保证chrome文件夹和chromedriver环境已经就绪,同时EasySpider主程序已在运行中

在当前文件夹下直接运行程序:

python3 easyspider_executestage.py --id [1]

以上是运行任务号为1的任务的示例命令,更多命令行参数使用说明请参考:Argument Instruction


Before running the program, make sure you have completed the compilation of the main program in the ElectronJS folder and ensure that the chrome folder and chromedriver environment are ready. Also, ensure that the EasySpider main program is already running.

To run the program directly in the current folder, use the following command:

python3 easyspider_executestage.py --id [1]

The above is an example command to run a task with the ID of 1. For more information on command-line parameters, please refer to: Argument Instruction on the project's GitHub Wiki.

VS Code调试|VS Code Debug

可以用VS Code打开此文件夹即可调试程序,可修改.vscode下的launch.json文件中的调试参数,调试说明参考:https://zhuanlan.zhihu.com/p/41189402

You can use VS Code to open this folder and debug the program. You can modify the debugging parameters in the launch.json file located under the .vscode folder. For instructions on debugging with VSCode, you can refer to this guide: Debugging Python with Visual Studio Code.

打包说明|Package Instruction

如果想要在主程序直接点击本地直接运行按钮即可执行程序,则需要打包程序为可执行程序。

Windows x64直接运行generateEXE_win64.cmd即可把执行阶段程序打包成exe文件并自动拷贝到../ElectronJS/chrome_win64/目录下,其他系统同理。


To execute the program by simply clicking the Directly Run Locally button in the main program, you will need to package the program into an executable file.

For Windows x64, you can run the generateEXE_win64.cmd script. This script will package the execution stage program into an .exe file and automatically copy it to the ../ElectronJS/chrome_win64/ directory. The process for other systems is similar.