search

Nandaka / DanbooruDownloader

*booru image downloader
http://nandaka.devnull.zone/
392 stars 38 forks source link

furry.booru.org support #234

Open VanTuz5 opened 3 years ago

VanTuz5 commented 3 years ago

Please add support for furry.booru.org. Yes, this is actually a mirror of the e621, but there are arts that have been removed from there.

Nandaka commented 3 years ago

looks like the API is slightly different? I tried to add in 'DanbooruProviderList.xml' but it only able to load 1 post per query (by right it should be able to load 100 post).

You can try to use https://github.com/Bionus/imgbrd-grabber instead as it offer more capabilities.

VanTuz5 commented 3 years ago

Grabber does not show search results for this site and does not download anything from it. At least for me. I contacted the developer, but received no response. That's why I hoped that your program will help, as it helped with sankaku.

Nandaka commented 3 years ago

I think it is because furry.booru.org uses clouldflare ddos protection? so maybe you need to copy the cookies from the browser?

VanTuz5 commented 3 years ago

I tried, but this didn't work

Nandaka commented 3 years ago

ok, try this: update the DanbooruProviderList.xml and add this (backup the original file first). You need to update the cookie value similar like sankaku to bypass the Cloudflare. 

  <DanbooruProvider>
    <Name>furry.booru.org</Name>
    <DefaultLimit>20</DefaultLimit>
    <HardLimit>20</HardLimit>
    <Preferred>Xml</Preferred>
    <QueryStringXml>/index.php?page=dapi&amp;s=post&amp;q=index&amp;%_query%</QueryStringXml>
    <QueryStringJson />
    <QueryStringHtml>/index.php?page=post&amp;s=list&amp;%_query%</QueryStringHtml>
    <Url>https://furry.booru.org</Url>
    <UserName>__cfduid=?; cf_clearance=?</UserName>
    <Password />
    <LoginType>Cookie</LoginType>
    <PasswordSalt />
    <PasswordHash />
    <BoardType>Gelbooru</BoardType>
    <TagDownloadUseLoop>false</TagDownloadUseLoop>
    <DateTimeFormat>ddd MMM dd HH:mm:ss zzz yyyy</DateTimeFormat>
  </DanbooruProvider>
VanTuz5 commented 3 years ago

I added __cfduid and cf_clearance but the program don't download anything

VanTuz5 commented 3 years ago

And this happened image

Nandaka commented 3 years ago

update the user agents in settings to match the browser.

VanTuz5 commented 3 years ago

didn't help

Nandaka commented 3 years ago

Well too bad then. it is working from my side.

User agent same with browser. image

Cookies is set in the username field. image image

Result. image

VanTuz5 commented 3 years ago

I don't understand anything ... Everything that needs to be entered is entered, all cookies and user-agent, but instead of search results it gives an error. What am I doing wrong?

VanTuz5 commented 3 years ago

Подробная информация об использовании оперативной (JIT) отладки вместо данного диалогового окна содержится в конце этого сообщения.

** Текст исключения ** System.Xml.XmlException: Открывающий тег "meta" в позиции 8 строки 33 не соответствует закрывающему тегу "head"., строка 67, позиция 3. в System.Xml.XmlTextReaderImpl.Throw(Exception e) в System.Xml.XmlTextReaderImpl.ThrowTagMismatch(NodeData startTag) в System.Xml.XmlTextReaderImpl.ParseEndElement() в System.Xml.XmlTextReaderImpl.ParseElementContent() в DanbooruDownloader3.DAO.DanbooruPostDao.ProcessXML(String rawData) в DanbooruDownloader3.DAO.DanbooruPostDao..ctor(Stream input, DanbooruPostDaoOption option) в DanbooruDownloader3.FormMain.clientList_DownloadDataCompleted(Object sender, DownloadDataCompletedEventArgs e) в System.Net.WebClient.OnDownloadDataCompleted(DownloadDataCompletedEventArgs e)

** Загруженные сборки ** mscorlib Версия сборки: 4.0.0.0 Версия Win32: 4.8.4341.0 built by: NET48REL1LAST_C CodeBase: file:///C:/Windows/Microsoft.NET/Framework64/v4.0.30319/mscorlib.dll

DanbooruDownloader3 Версия сборки: 3.2020.10.25 Версия Win32: 3.2020.10.25 CodeBase: file:///E:/pictures/h/download/DanbooruDownloader3.20201025/DanbooruDownloader3.exe

System Версия сборки: 4.0.0.0 Версия Win32: 4.8.4300.0 built by: NET48REL1LAST_C CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll

DanbooruDBProvider Версия сборки: 1.2020.6.14 Версия Win32: 1.2020.06.14 CodeBase: file:///E:/pictures/h/download/DanbooruDownloader3.20201025/DanbooruDBProvider.DLL

System.Windows.Forms Версия сборки: 4.0.0.0 Версия Win32: 4.8.4341.0 built by: NET48REL1LAST_C CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll

System.Drawing Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll

log4net Версия сборки: 1.2.11.0 Версия Win32: 1.2.11.0 CodeBase: file:///E:/pictures/h/download/DanbooruDownloader3.20201025/log4net.DLL

System.Configuration Версия сборки: 4.0.0.0 Версия Win32: 4.8.4190.0 built by: NET48REL1LAST_B CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll

System.Core Версия сборки: 4.0.0.0 Версия Win32: 4.8.4341.0 built by: NET48REL1LAST_C CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll

System.Xml Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll

System.Data.SQLite Версия сборки: 1.0.113.0 Версия Win32: 1.0.113.0 CodeBase: file:///E:/pictures/h/download/DanbooruDownloader3.20201025/System.Data.SQLite.DLL

System.Data Версия сборки: 4.0.0.0 Версия Win32: 4.8.4270.0 built by: NET48REL1LAST_C CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_64/System.Data/v4.0_4.0.0.0__b77a5c561934e089/System.Data.dll

System.Transactions Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_64/System.Transactions/v4.0_4.0.0.0__b77a5c561934e089/System.Transactions.dll

System.EnterpriseServices Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_64/System.EnterpriseServices/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.EnterpriseServices.dll

System.Windows.Forms.resources Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms.resources/v4.0_4.0.0.0_ru_b77a5c561934e089/System.Windows.Forms.resources.dll

Accessibility Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/Accessibility/v4.0_4.0.0.0__b03f5f7f11d50a3a/Accessibility.dll

Microsoft.VisualBasic Версия сборки: 10.0.0.0 Версия Win32: 14.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/Microsoft.VisualBasic/v4.0_10.0.0.0__b03f5f7f11d50a3a/Microsoft.VisualBasic.dll

System.Web Версия сборки: 4.0.0.0 Версия Win32: 4.8.4330.0 built by: NET48REL1LAST_B CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_64/System.Web/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Web.dll

System.resources Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.resources/v4.0_4.0.0.0_ru_b77a5c561934e089/System.resources.dll

mscorlib.resources Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/mscorlib.resources/v4.0_4.0.0.0_ru_b77a5c561934e089/mscorlib.resources.dll

System.xml.resources Версия сборки: 4.0.0.0 Версия Win32: 4.8.4084.0 built by: NET48REL1 CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Xml.resources/v4.0_4.0.0.0_ru_b77a5c561934e089/System.Xml.resources.dll

** Оперативная отладка (JIT) ** Для подключения оперативной (JIT) отладки файл .config данного приложения или компьютера (machine.config) должен иметь значение jitDebugging, установленное в секции system.windows.forms. Приложение также должно быть скомпилировано с включенной отладкой.

Например:

При включенной отладке JIT любое необрабатываемое исключение пересылается отладчику JIT, зарегистрированному на данном компьютере, вместо того чтобы обрабатываться данным диалоговым окном.

VanTuz5 commented 3 years ago

I rebuilt the app myself, but now it requires cookies. I added them, but it didn't help.

Nandaka commented 3 years ago

I'm also not sure why, because it is supposed open the xml from the API from https://furry.booru.org/index.php?page=dapi&s=post&q=index. From the error, looks like it still return the cloudflare page.

VanTuz5 commented 3 years ago

Through the browser, the site opens normally, but whatever program I try to use to download images from there, nothing works. Even with sankaku, there is no such problem.