im more interested in firefox addson named UnMHT that can saved in multitab in one click for my requirement. iMicros is more like a video saving the webpages but i didt choose it. i choose UnMHT and it saved in .MHT format only.
if i have more money to buy expensive data then i have no problem using wget or site-grabber apps.
here is my procedure:
first creating the code named "divide_list_to_five_file.bat" below to separate list of URL address into 5 files with 10 links per files :
Code: Select all
@ECHO OFF
SETLOCAL ENABLEDELAYEDEXPANSION
set "URL=0"
for /f "delims=" %%a in (selected.txt) do (
set "m=%%a"
set /a "URL+=1"
if !URL! LEQ 10 echo !m! >>firefox_URL_list1.txt
if !URL! GEQ 11 if !URL! LSS 21 echo !m! >>firefox_URL_list2.txt
if !URL! GEQ 21 if !URL! LSS 31 echo !m! >>firefox_URL_list3.txt
if !URL! GEQ 31 if !URL! LSS 41 echo !m! >>firefox_URL_list4.txt
if !URL! GEQ 41 echo !m! >>firefox_URL_list5.txt
)
pause
second creating the code named "open_multi_tabs.bat" to open 10 multitab per window per one file :
Code: Select all
@ECHO OFF
SETLOCAL ENABLEDELAYEDEXPANSION
echo list1.txt:
echo.
ping -n 5 localhost >nul
for /f %%a in (firefox_URL_list1.txt) do (
set "m=%%a"
set "n=ping -n 10 localhost"
start "" firefox.exe -new-tab "!m!"
echo !m!
!n! >nul
)
timeout 300
cls
echo list2.txt:
echo.
for /f %%a in (firefox_URL_list2.txt) do (
set "m=%%a"
set "n=ping -n 5 localhost"
start "" firefox.exe -new-tab "!m!"
echo !m!
!n! >nul
)
timeout 300
cls
echo list3.txt:
echo.
for /f %%a in (firefox_URL_list3.txt) do (
set "m=%%a"
set "n=ping -n 5 localhost"
start "" firefox.exe -new-tab "!m!"
echo !m!
!n! >nul
)
timeout 300
cls
echo list4.txt:
echo.
for /f %%a in (firefox_URL_list4.txt) do (
set "m=%%a"
set "n=ping -n 5 localhost"
start "" firefox.exe -new-tab "!m!"
echo !m!
!n! >nul
)
timeout 300
cls
echo list5.txt:
echo.
for /f %%a in (firefox_URL_list5.txt) do (
set "m=%%a"
set "n=ping -n 5 localhost"
start "" firefox.exe -new-tab "!m!"
echo !m!
!n! >nul
)
pause
third, i use addson named
Web Developer 1.2.5 to grabbed all links of webpage and manually trimmed all unused blanklines/spaces using notepad2.exe and output result to "input.txt" and then use Aacini's fastest sort script and output to "sorted_input.txt" then manually and easily copy selected links in one highlight and paste to a file named "selected.txt"
here is the code of Aacini sort script
Code: Select all
@if (@CodeSection == @Batch) @then
@echo off
CScript //nologo //E:JScript "%~F0" < input.txt > sorted_input.txt
goto :EOF
@end
// JScript section
var name = new Array(), file, len, a;
while ( ! WScript.Stdin.AtEndOfStream ) { // for /F "delims=" %%a in (input.txt) do (
file = WScript.Stdin.ReadLine(); // set "file=%%a"
// call :StrLenVar file len=
len = "000"+file.length; // set len=000!len!
name.push(len.slice(-4)+file); // set name[!len:~-4!;!file!]=1
} // )
name.sort(); // rem In Batch the arrays are kept always sorted by index
for ( a in name ) WScript.Echo(name[a].substr(4)); // for /F "tokens=2 delims=;]" %%a in ('set name[') do echo %%a
finally with all the ff. file/.bat ready:
selected.txt
divide_list_to_five_file.bat
open_multi_tabs.bat
then i run the code named "start_processing_10_tab.bat" below:
Code: Select all
@echo off
ping -n 5 localhost >nul
echo start processing ^( divide_list_to_five_file.bat ^)
echo processing ^( open_multi_tabs.bat ^)
ping -n 5 localhost >nul
start "" divide_list_to_five_file.bat
start "" open_multi_tabs.bat
and observed and found out if 10 multitab completed their loading:
1. press multitab UnMHT saving button
2. selecting all 10 links
3. press ok to save to destination folder.
since 300 seconds is the timeout for processing another 10 multitab,
i already have allowances of 100 seconds so that 10 webpages should be completely saved.
of course if it already finished earlier then i cant wait timeout to finish but had a press enter to continue next 10 load of links.
thats all i do.
--------------------------------
actually my affordable network-data has the following status:
can't use wget and downloader
has a speed download of 10 KB/sec or 100kbps.
upload speed is 2KB/sec or below
----------------
bars
===============
i edit above to remove my claims on Aacini sort script and replace with new code named "start_processing_10_tab.bat"