Adding Genius Lyrics to aimp_webLyrics.ini

[c0der]

Hey there.

I would like to add Genius Lyrics (https://genius.com/) as one page where the lyrics get requested from.

I know that there's a tag on the website starting with: "<meta content="{&quot;chartbeat" holding ALL the songs information in json format (artist, title, image-urls, producers, etc) and another node <div class="lyrics" that contains a simple <p> holding the lyrics in html format (obviously) since I wrote an app that fetches lyrics from there.
The URL structure is as follows: genius.com/{artist}-{title}-lyrics

Is there any explanation of the parameters within the config file and how the dll parses the result so I can try to implement the request to genius lyrics through the config?

Thanks in advance.

[sveakul]

The entry in the aimp_webLyrics.ini file that worked for Genius up until this summer, written by sabadell66, is below.  It doesn't work anymore due to site changes at Genius, but hopefully it may give you some direction on how to proceed:

[genius.com]
Class=TAIMPLyricsWebPageBasedProvider
CustomHeaders=\ncontent-type: application/json; charset=utf-8\ncontent-encoding: gzip
SearchQuery=https://genius.com/api/search/multi?per_page=5&q=%artist%+%title%
Encoding=URL
SearchResultPageStartTags="url":"
SearchResultPageFinishTags=",
LyricsPageTitleStartTags={"name":"song_title","values":["
LyricsPageTitleFinishTags="]
LyricsPageArtistStartTags={"name":"artist_name","values":["
LyricsPageArtistFinishTags="]
LyricsPageTextStartTags=<div class="Lyrics__Container-sc-1ynbvzw-6 krDVEH">
LyricsPageTextFinishTags=<div class="SidebarAd__Container-sc-1cw85h6-0 dmUBmo">

[c0der]

Last two lines have to be as follows:

LyricsPageTextStartTags=<div class="Lyrics__Container-sc-1ynbvzw-8 eOLwDW">
LyricsPageTextFinishTags=<div class="Lyrics__Footer-sc-1ynbvzw-2 gJmUoe">

It's working again. Thanks for your help.

Edit:
Note that you will still need to have some fallback pages to request lyrics from since sometimes the lyrics cannot be fetched from genius.

[sveakul]

cOder:  for some reason it's still not working here after changing those last 2 lines--would you be kind enough to post your complete [genius.com] entry?  Maybe I've missed something elsewhere.

In return, here are the rest of my entries, all of them working(thanks to sabadell66 for these):

Code: [Select]

[azlyrics.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=https://search.azlyrics.com/search.php?q=%artist%%20%title%
Encoding=URL
SearchResultPageStartTags=<a href="
SearchResultPageFinishTags=">
LyricsPageArtistStartTags=ArtistName = "
LyricsPageArtistFinishTags=";
LyricsPageTitleStartTags=SongName = "
LyricsPageTitleFinishTags=";
LyricsPageTextStartTags=<!-- Usage of azlyrics.com content by any third-party lyrics provider is prohibited by our licensing agreement. Sorry about that. -->
LyricsPageTextFinishTags=</div>
LyricsPageTextPostProcessExpression=https://source_AZLYRICS.COM\n%Value

[musixmatch.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=https://www.musixmatch.com/search/%artist%%20%title%
Encoding=URL
SearchResultPageStartTags=</div><meta content="
SearchResultPageFinishTags="
SearchResultPagePostProcessExpression=https://www.musixmatch.com%Value
LyricsPageArtistStartTags=mxm-track-title__artist-link">
LyricsPageArtistFinishTags=</a>
LyricsPageTitleStartTags=<small>Lyrics</small>
LyricsPageTitleFinishTags=</h1>
LyricsPageTextStartTags="body":"
LyricsPageTextFinishTags=",
LyricsPageTextPostProcessExpression=https://source_MUSIXMATCH.COM\n%Value

[songlyrics.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=http://www.songlyrics.com/index.php?section=search&searchW=%artist% %title%&submit=Search
SearchResultPageStartTags=<div class="serpresult">|<a href="
SearchResultPageFinishTags=</div>|"
LyricsPageArtistStartTags=artist: "
LyricsPageArtistFinishTags=",
LyricsPageTitleStartTags=song: "
LyricsPageTitleFinishTags=",
LyricsPageTextStartTags=<p id="songLyricsDiv"  class="songLyricsV14 iComment-text">
LyricsPageTextFinishTags=</p>
LyricsPageTextPostProcessExpression=https://source_SONGLYRICS.COM\n%Value

[c0der]

I'm using the exact same lines you posted before except the last two. For completeness sake, below is my full config.
Keep in mind that the Genius URL structure is as follows: genius.com/{artist}-{title}-lyrics

Example: You have the following song including ID3-Tags in MP3 file - "Kool Savas - AMG"
But the correct URL in genius is: "genius.com/kool-savas-and-alies-amg-lyrics"
So, because of some smaller feature artists the plugin might not find a result.
I tested it with around 20 files and like 80-90% are downloaded from genius (you can see that in the .LRC file that is placed next to the mp3 file you played).

Code: [Select]


[genius.com]
Class=TAIMPLyricsWebPageBasedProvider
CustomHeaders=\ncontent-type: application/json; charset=utf-8\ncontent-encoding: gzip
SearchQuery=https://genius.com/api/search/multi?per_page=5&q=%artist%+%title%
Encoding=URL
SearchResultPageStartTags="url":"
SearchResultPageFinishTags=",
LyricsPageTitleStartTags={"name":"song_title","values":["
LyricsPageTitleFinishTags="]
LyricsPageArtistStartTags={"name":"artist_name","values":["
LyricsPageArtistFinishTags="]
LyricsPageTextStartTags=<div class="Lyrics__Container-sc-1ynbvzw-8 eOLwDW">
LyricsPageTextFinishTags=<div class="Lyrics__Footer-sc-1ynbvzw-2 gJmUoe">
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.genius.com

[azlyrics.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=https://search.azlyrics.com/search.php?q=%artist%%20%title%
Encoding=URL
SearchResultPageStartTags=<a href="
SearchResultPageFinishTags=">
LyricsPageArtistStartTags=ArtistName = "
LyricsPageArtistFinishTags=";
LyricsPageTitleStartTags=SongName = "
LyricsPageTitleFinishTags=";
LyricsPageTextStartTags=<!-- Usage of azlyrics.com content by any third-party lyrics provider is prohibited by our licensing agreement. Sorry about that. -->
LyricsPageTextFinishTags=</div>
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.azlyrics.com

[musixmatch.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=https://www.musixmatch.com/search/%artist%%20%title%
Encoding=URL
SearchResultPageStartTags=</div><meta content="
SearchResultPageFinishTags="
SearchResultPagePostProcessExpression=https://www.musixmatch.com%Value
LyricsPageArtistStartTags=mxm-track-title__artist-link">
LyricsPageArtistFinishTags=</a>
LyricsPageTitleStartTags=<small>Lyrics</small>
LyricsPageTitleFinishTags=</h1>
LyricsPageTextStartTags="body":"
LyricsPageTextFinishTags=",
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.musixmatch.com

[songlyrics.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=http://www.songlyrics.com/index.php?section=search&searchW=%artist% %title%&submit=Search
SearchResultPageStartTags=<div class="serpresult">|<a href="
SearchResultPageFinishTags=</div>|"
LyricsPageArtistStartTags=artist: "
LyricsPageArtistFinishTags=",
LyricsPageTitleStartTags=song: "
LyricsPageTitleFinishTags=",
LyricsPageTextStartTags=<p id="songLyricsDiv"  class="songLyricsV14 iComment-text">
LyricsPageTextFinishTags=</p>
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.songlyrics.com




[sveakul]

Thanks c0der for posting your complete entry.  Genius working fine again here!  Skål/За тебя!

[c0der]

I edited my config from the previous post a little since the LyricsPageTextFinishTags had multiple occurrences for some songs.
Now it should work flawless. Also added the base-url for the lyrics page the data are loaded from as PostProcessExpression as bottom line of the lyrics data.

I don't speak/understand russian, but you're welcome brother

[c0der]

Here's an example screenshot of how the data get loaded on my side.

[sveakul]

@c0der:  It doesn't seem that Genius is drawing any lyrics for the past 2 days--was working fine before then using your last posted script!  Have they changed search methods again, and have you found a solution that you can share?

[c0der]

@sveakul: First off all, thanks for your information!
And yes, seems like they did changes. The "LyricsPageTextStartTags" value changed.
Attached you will find my full config including the changed Genius section.

Code: [Select]

[genius.com]
Class=TAIMPLyricsWebPageBasedProvider
CustomHeaders=\ncontent-type: application/json; charset=utf-8\ncontent-encoding: gzip
SearchQuery=https://genius.com/api/search/multi?per_page=5&q=%artist%+%title%
Encoding=URL
SearchResultPageStartTags="url":"
SearchResultPageFinishTags=",
LyricsPageTitleStartTags={"name":"song_title","values":["
LyricsPageTitleFinishTags="]
LyricsPageArtistStartTags={"name":"artist_name","values":["
LyricsPageArtistFinishTags="]
LyricsPageTextStartTags=<div class="Lyrics__Container-sc-1ynbvzw-8 beMmeb">
LyricsPageTextFinishTags=<div class="Lyrics__Footer-sc-
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.genius.com

[azlyrics.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=https://search.azlyrics.com/search.php?q=%artist%%20%title%
Encoding=URL
SearchResultPageStartTags=<a href="
SearchResultPageFinishTags=">
LyricsPageArtistStartTags=ArtistName = "
LyricsPageArtistFinishTags=";
LyricsPageTitleStartTags=SongName = "
LyricsPageTitleFinishTags=";
LyricsPageTextStartTags=<!-- Usage of azlyrics.com content by any third-party lyrics provider is prohibited by our licensing agreement. Sorry about that. -->
LyricsPageTextFinishTags=</div>
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.azlyrics.com

[musixmatch.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=https://www.musixmatch.com/search/%artist%%20%title%
Encoding=URL
SearchResultPageStartTags=</div><meta content="
SearchResultPageFinishTags="
SearchResultPagePostProcessExpression=https://www.musixmatch.com%Value
LyricsPageArtistStartTags=mxm-track-title__artist-link">
LyricsPageArtistFinishTags=</a>
LyricsPageTitleStartTags=<small>Lyrics</small>
LyricsPageTitleFinishTags=</h1>
LyricsPageTextStartTags="body":"
LyricsPageTextFinishTags=",
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.musixmatch.com

[songlyrics.com]
Class=TAIMPLyricsWebPageBasedProvider
SearchQuery=http://www.songlyrics.com/index.php?section=search&searchW=%artist% %title%&submit=Search
SearchResultPageStartTags=<div class="serpresult">|<a href="
SearchResultPageFinishTags=</div>|"
LyricsPageArtistStartTags=artist: "
LyricsPageArtistFinishTags=",
LyricsPageTitleStartTags=song: "
LyricsPageTitleFinishTags=",
LyricsPageTextStartTags=<p id="songLyricsDiv"  class="songLyricsV14 iComment-text">
LyricsPageTextFinishTags=</p>
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.songlyrics.com


[sveakul]

Thanks a million c0der for the fix, Genius is working fine again!  Your efforts are much appreciated.

[sveakul]

@coder:  I hate to say this, but it looks like Genius has changed yet again--no more lyrics as of 2 days ago with your newest script.  I get the feeling they are altering this deliberately at intervals to screw up lyric-scraping scripts, maybe in response to usage.  Not sure if anything can be done about it, but a shame to lose this source.  Musixmatch, AZLyrics, and Song Lyrics all still working fine, thankfully.

[c0der]

I changed three parameters in the config file to parse the raw lyrics part from the always existing raw data json node. But the lyrics post process function doesn't return the corrent value since the expression doesn't replace the given character. I will post the code and some example lyrics below.

Code: [Select]

LyricsPageTextStartTags="body\":{\"html\":\"
LyricsPageTextFinishTags=\",
LyricsPageTextPostProcessExpression=%REPLACE(%Value, "\\", "")

Example Lyrics:

Code: [Select]

[Chorus: Chris Brown with Nicki Minaj]
\
Yeah, yeah, baby, is you drunk? Is you had enough?
\
Are you here lookin' for love? Ooh, ooh
\
Got the club goin' crazy
\
...

Maybe you or somebody else that worked more with the .dll library knows how to change the code. I am still trying possible approaches myself.

[sveakul]

Thanks for your response.  Yes, I also found that while it's returning Genius lyrics again the %REPLACE expression is being ignored--why, I don't know either.  Maybe another skilled user like sabadell66 who came up with the first string that worked can help us out here.  In the meantime, I hope your own experiments are successful and that you'll post here!  Thanks for looking into this.

[c0der]

Found a solution that seems to change less often since the tags I use don't contain any "random" parts.

Code: [Select]

[genius.com]
Class=TAIMPLyricsWebPageBasedProvider
CustomHeaders=\ncontent-type: application/json; charset=utf-8\ncontent-encoding: gzip
SearchQuery=https://genius.com/api/search/multi?per_page=5&q=%artist%+%title%
Encoding=URL
SearchResultPageStartTags="url":"
SearchResultPageFinishTags=",
LyricsPageTitleStartTags={"name":"song_title","values":["
LyricsPageTitleFinishTags="]
LyricsPageArtistStartTags={"name":"artist_name","values":["
LyricsPageArtistFinishTags="]
LyricsPageTextStartTags=<div id="lyrics-root-pin-spacer">
LyricsPageTextFinishTags=<div class="Lyrics__Footer-sc-
LyricsPageTextPostProcessExpression=%Value\n\nhttps://www.genius.com