YT-dlp enhanced JSON handling with additional logging and data extraction. - #2810
Open
ZealousLover wants to merge 1 commit into
Open
YT-dlp enhanced JSON handling with additional logging and data extraction.#2810ZealousLover wants to merge 1 commit into
ZealousLover wants to merge 1 commit into
Conversation
Fixed some misaligned values (e.g. 'extractor' is not 'tubesite' and 'uploader' is 'studio') Added converting chapters to scene markers.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixed some misaligned values (e.g. 'extractor' is
not 'tubesite' and 'uploader' is 'studio')
Added converting chapters to scene markers.
Examples to test
yt-dlpto download from various sites. Include the parameter--write-info-jsonto generate the metadata JSON file for the downloadFrom the "Scenes" tab
From a scene:
From "Settings"->"Tasks"
Short description
The previous version was extracting various items with some assumption about thier meaning.
The "details" field should be a description of the video and the YT-dlp JSON includes a "description" which is now added. Previously, "details" was only populated with various additional metadata like "uploaded by", "extractor", etc. This additional metadata is appended to the end of the new "details" that includes the "description."
The "extractor" field was being used as the "tubesite" which may not always be the same. Now, "extractor" merely points to the YT-dlp extractor name and is included at the end of "details"
The "tubesite" extra metadata is extrapolated from the URL instead of assuming "extractor", which may include the "generic" extractor name. This is now part of the appended data in "details."
Many of the YT-dlp extractors use "uploader" to indicate the channel or production studio for porn sites, (see pornhub.py), this scraper now makes that correlation too.
The YT-dlp JSON supports "chapters" which can be adapted to "Scene Markers" in Stash. This scraper now looks for chapters and create scene markers for the chapters. The primary tag is also created if one does not exist.