Skip to main content

Notice

Please note that most of the software linked on this forum is likely to be safe to use. If you are unsure, feel free to ask in the relevant topics, or send a private message to an administrator or moderator. To help curb the problems of false positives, or in the event that you do find actual malware, you can contribute through the article linked here.
Topic: iTSfv - iTunes Store file validator (Read 419872 times) previous topic - next topic
0 Members and 2 Guests are viewing this topic.

iTSfv - iTunes Store file validator

Reply #475
Hi alexcel,

1/ I see something weird going on with iTunes and comments being rewritten back.

2/ For Synchrocleaning M4P files, please add the extension m4p here:



3/ iTSfv was looking for all possible artwork in the album folder so if you were checking for existence of Folder.jpg and if iTSfv found Artwork.jpg there instead, it would still report as there is Artwork. This is fixed for the next build.


5.60.4.2 Checking for missing Artwork checked the presence of all possible artwork files in the album directory [alexcel]
5.60.4.1 Checking for missing Artwork did not run for Check Standard in Selected Tracks button
5.60.4.0 Artwork thumbnail in the Artwork Chooser dialog box is double clickable
5.60.3.3 Fixed instability during editing tracks if the track locations were longer than 260 characters
5.60.3.2 Fixed instability during validation of discs if the track locations were longer than 260 characters [MJC]

Cheers.

iTSfv - iTunes Store file validator

Reply #476
Hi MCoreD

Thanks for the reply.


On the comments topic, any ideas on how to remove those old comments ans solve the issue?

And lastly, I have a digital booklet on pdf format that is giving me a lot of errors. could you fix it?

Thanks!!

iTSfv - iTunes Store file validator

Reply #477
Alex,

Were the comments you removed similar to

000005D1 0000069B 000012D6 000015BE 0002B584 0002DD24 000063B0

I managed to track this issue

5.60.5.1 Albums without consecutive tracks log file was not updated for validating selected tracks [Pythago]
5.60.5.0 Remove Lyrics from Track feature in Selected Tracks : Editor is now extended to remove Comments
5.60.4.3 Update Database refreshing tags in file settings did not sometimes remove junk comments such as 000005D1 0000069B 000012D6 000015BE 0002B584 0002DD24 000063B0 [alexcel]
5.60.4.2 Checking for missing Artwork checked the presence of all possible artwork files in the album directory [alexcel]

I am afraid fixing PDF is beyond the scope of iTunes Store file validator despite it being a valid iTunes Store file.

iTSfv - iTunes Store file validator

Reply #478
I am afraid fixing PDF is beyond the scope of iTunes Store file validator despite it being a valid iTunes Store file.


No, no, no, I just want to skip pdf files and avoid the errors itsfv shows...cause it can't write to pdf, of course

The comments I removed were comments written by me plus some others that were string of numbers as you showed (000005D1 0000069B 000012D6 000015BE 0002B584 0002DD24 000063B0)

I'll give a try to the new beta as soon as you publish it.

Thanks!!

iTSfv - iTunes Store file validator

Reply #479
Hi alexcel,

I wasn't aware that PDF files were included in the validation process and see no reason how. What errors does iTSfv show? Could you please send your error/warning logs? You can do so by Help menu : Submit bug report...

Cheers.

iTSfv - iTunes Store file validator

Reply #480
Adding new tracks via the explorer tab has stopped working for me. It looks like it's trying to add the files using a path that is different than the actual file paths. The lines below show up in my warning log. I have replaced some of the personal text, but it shouldn't make a difference.

The files aren't really in D:\User's Music\Artist, they are in D:\User's Music\Radio Shows\Artist.

D:\User's Music is my iTunes library location and it is set as my music folder location in iTSFv.

Ok, I've done some more testing. If I change the option "When adding files not under any music folder locations" from "Copy to music folders" to "let iTunes determine", then the program successfully adds the files to the library, but when it does so it tries to re-organize them in the filesystem based on the "Organize music files as" setting.

When the files are already in a music folder defined in iTSFv, I don't think the program should be worrying about copying them anywhere or reorganizing them. When I place the files in my music folder, I have them organized the way I want them. The program never did this before the last few releases.

Code: [Select]
2008-05-18T10:15:05 Could not find a part of the path 'D:\User's Music\Artist\Album\01. Title 1.mp3'. for D:\User's Music\Artist\Album\01. Title 1.mp3
2008-05-18T10:15:07 Could not find a part of the path 'D:\User's Music\Artist\Album\04. Title 4.mp3'. for D:\User's Music\Artist\Album\04. Title 4.mp3
2008-05-18T10:15:07 Could not find a part of the path 'D:\User's Music\Artist\Album\03. Title 3.mp3'. for D:\User's Music\Artist\Album\03. Title 3.mp3
2008-05-18T10:15:07 Could not find a part of the path 'D:\User's Music\Artist\Album\02. Title 2.mp3'. for D:\User's Music\Artist\Album\02. Title 2.mp3

iTSfv - iTunes Store file validator

Reply #481
Hi xanadu1979,

Some work was done in the Adding files section according to a few posts below.

Untick Organize Music files as

and could you please retry for now?

Thanks,
McoreD

iTSfv - iTunes Store file validator

Reply #482
Ok, I've done some more testing. If I change the option "When adding files not under any music folder locations" from "Copy to music folders" to "let iTunes determine", then the program successfully adds the files to the library, but when it does so it tries to re-organize them in the filesystem based on the "Organize music files as" setting.


xanadu,

I have figured out the cause of this.

Here is a ClickOnce package of iTSfv that has the above fix

http://wmwiki.com/mcored/research/itsfv/setup.exe

5.60.5.2 Adding music files from Music folder did not work properly if Organize files checkBox was turned on after build 5.60.3.0 [xanadu1979]



Cheers,
McoreD

iTSfv - iTunes Store file validator

Reply #483
Yes, that seems to have fixed it.

But, the ClickOnce package didn't cleanly install over my existing iTSFv. It didn't bring over my settings or anything. Is that because it was just a build for testing?

I uninstalled the ClickOnce version and the existing version still works fine. So I'll wait for the installer to show up on sourceforge.

iTSfv - iTunes Store file validator

Reply #484
xanadu,

When you say existing version still working fine - do you mean after unchecking Organize files as checkBox?

ClickOnce installs are independent from InnoSetup installed versions. My future plan was to eventually completely move to ClickOnce installs. You can restore settings into ClickOnce iTSfv using Options > Advanced > Paths.

iTSfv - iTunes Store file validator

Reply #485
Hi:

I've given a try to latest beta build.

I do not know if I am understanding the option wrong, but this is what is happening to me with option "Update database refreshing tags in files" enabled:
1.- I remove all comments using mp3tag2.41. I double check comments are effectively removed
2.- The comments are still present in ITunes db.
3.- I run ITSFV with option "Update database refreshing..."
4.- I open ITunes and comments are still present
5.- I check with mp3tag and comments are rewritten back to my files

So it seems that instead of updating my ITunes db from tags in my files iTSFV is updating my tags from my database content. It is the opposite as I supposed iTSFV would do.

Maybe I have understood the option wrong, all the way around.

Please let me know.

On the other issue, pdf files, they are not errors properly said (ITSFV does not crash or hang at all), but appear as ITSFV non-compliant tags, ITSFV tries to find artwork with google, etc, and the process slows down. There appear several warnings in the logs. SO, I can't send a bug. Sorry for misleading you. My english is not so good.

iTSfv - iTunes Store file validator

Reply #486
xanadu,

When you say existing version still working fine - do you mean after unchecking Organize files as checkBox?


No, I just meant that uninstalling the ClickOnce version didn't screw up the InnoSetup version.


On the other issue, pdf files, they are not errors properly said (ITSFV does not crash or hang at all), but appear as ITSFV non-compliant tags, ITSFV tries to find artwork with google, etc, and the process slows down. There appear several warnings in the logs. SO, I can't send a bug. Sorry for misleading you. My english is not so good.


I also noticed that the program was trying to process a pdf file when I validated my library with the latest version of iTSFv. It didn't seem to cause any problems but I can see how it would slow down the process if you had a lot of pdf's in your music folder.

 

iTSfv - iTunes Store file validator

Reply #487
Are you going to an InnoSetup version of 5.60.5.2? If not, are you going to keep pushing builds of the ClickOnce version? I'm fine with migrating my settings over to the ClickOnce install as long as you keep making builds with it. I don't want to switch back and forth between ClickOnce and InnoSetup.

iTSfv - iTunes Store file validator

Reply #488
Are you going to do an InnoSetup version of 5.60.5.2? If not, are you going to keep pushing builds of the ClickOnce version? I'm fine with migrating my settings over to the ClickOnce install as long as you keep making builds with it. I don't want to switch back and forth between ClickOnce and InnoSetup.


Hi xanadu1979,

I have uploaded the latest build to SF.net

5.60.5.3 Removed possibility where iTunes database comments could sometimes be written back to ID3v2 comments tag [alexcel]
5.60.5.2 Adding music files from Music folder did not work properly if Organize files checkBox was turned on after build
5.60.3.0 [xanadu1979]
5.60.5.1 Albums without consecutive tracks log file was not updated for validating selected tracks [Pythago]
5.60.5.0 Remove Lyrics from Track feature in Selected Tracks : Editor is now extended to remove Comments

http://sourceforge.net/project/showfiles.p...ckage_id=243989


I was afraid that would be case: having two install methods in public, causing confusion. I scratched idea of rolling out ClickOnce installs in public, so it will not be the official method of deployment. I will continue to use SourceForge for releasing beta and stable builds as before.

I would suggest you continue using SourceForge for future builds.

Cheers,
McoreD

Off the record: yes, I will be rolling out ClickOnce installs as well, for private beta testing. (There is a few contacts via email/IM who deploy iTSfv using ClickOnce)

iTSfv - iTunes Store file validator

Reply #489
Hi:

I've given a try to latest beta build.

I do not know if I am understanding the option wrong, but this is what is happening to me with option "Update database refreshing tags in files" enabled:
1.- I remove all comments using mp3tag2.41. I double check comments are effectively removed
2.- The comments are still present in ITunes db.
3.- I run ITSFV with option "Update database refreshing..."
4.- I open ITunes and comments are still present
5.- I check with mp3tag and comments are rewritten back to my files

So it seems that instead of updating my ITunes db from tags in my files iTSFV is updating my tags from my database content. It is the opposite as I supposed iTSFV would do.

Maybe I have understood the option wrong, all the way around.

Please let me know.

On the other issue, pdf files, they are not errors properly said (ITSFV does not crash or hang at all), but appear as ITSFV non-compliant tags, ITSFV tries to find artwork with google, etc, and the process slows down. There appear several warnings in the logs. SO, I can't send a bug. Sorry for misleading you. My english is not so good.


alexcel,

You haven't misunderstood anything. It was just syncing between ID3v2 tags and iTunes XML Database being a bit tricky. I hope I got it right with the latest beta. iTunes was doing strange things with the Comments tag.

If removing Comments was your intention, there is a way in iTSfv too that I'd like to mention:



About the PDF issue:

When you have External files to be moved according to folder structure, iTSfv will attempt to move files from the old location to the new location. PDF files can be included in these non-audio files. This only happens if you changed the default behavior: Copy files to Default music folder in Options > Explorer.

alexcel, Could you still send me the warning log file to mcored@gmail.com?

You can disable iTSfv looking for Album Art etc, in Options > Advanced > Sources > Artwork.

Cheers.

iTSfv - iTunes Store file validator

Reply #490
Hi All,

Version 5.60.6.0 Beta released.

5.60.6.0 Optionally update POPM and PCNT frames while automatically adjusting ratings via Options : OneTouch : Library
5.60.5.6 Overwriting tags would not have worked if adding files belongs to a music folder after build 5.60.3.0
5.60.5.5 Fixed possible instabities while restoring rating tags from file [msg_id=4973339]
5.60.5.4 PDF files in iTunes Library were processed by iTSfv to add artwork and import lyrics causing warnings [alexcel]
5.60.5.3 Removed possibility where iTunes database comments could sometimes be written back to ID3v2 comments tag [alexcel]

http://sourceforge.net/project/showfiles.php?group_id=204248

iTSfv - iTunes Store file validator

Reply #491
Mike:

OK, I think I'm getting the hang of things but I've had some issues that I can't quite figure out.  iTSfv seems to do everything but wipe my ass so the learning curve is a little steep but I hope to tackle a few issues.  You suggested that I post my questions so here goes - and excuse me if I seem to be missing the obvious...

1)   If I wanted to have the MP3 tags mirror the iTunes databse info, is the "Refresh tags..." supposed to accomplish that?
2)   When exporting with the custom mask setting, it appears to be working, for the most part.  However, I've seen something strange happen (even after I got the 5.60.6.4 beta) - in iTunes, the tracks shows up like this:

Track Name: Tiësto Master Mix II (Mixed By DJ Vader)
Artist: Tiësto
Album Artist: Tiësto
Album: Tiësto Master Mix II

The export mask I am using is:
%AlbumArtist% - %Album% (%Year%) - %Track% - %Name% - %Artist%

The named file that exports is:
Tiësto - Tiësto Master Mix II (2007) - 01 - Tiësto Master Mix II - Tiësto.mp3

You'll notice that the %Name% field is different from the data within iTunes.

If I check the tags in the exported file, they are:

Track Name: Tiësto Master Mix II (Mixed By DJ Vader)
Artist: Tiësto
Album Artist: Tiësto
Album: Tiësto Master Mix II

Why is part of the track name being removed during the export?  It appears to only affect the track name and it appears to truncate the name as soon as it sees a paranthesis or bracket, for example.  Also, is there a paramter that can be used in the mask for the bitrate?

3)   If I'm using the export feature to export all tracks from an album to an external folder, is there a way to have the album's cover art get copied over to the destination folder as well, preferably in the same step?

4)   I saw from a previous post how to eliminate all comments from the files.  Is there a way within iTSfv to have it change all comment tags to the same thing - say a pre-defined string of text?  When I select tracks and have the "Remove Comment..." option checked, it appears that the original comment is removed but you end up with something like "00001109 0000112C 0000693D 0000560D 00037D25 00037D25 00008000 00008000 000048AF 00013787"

5)   I've gotten iTSfv to Capitalize the first letter of each word when validating but I notice that there are files for Capital words, Simple words & Replace words.  Should iTSfv be using these files when the capitalization is performed?

Thanks in advance for any info you (or any one else) can provide and for an excellent addition to iTunes.

Jeff

iTSfv - iTunes Store file validator

Reply #492
Hi jgcrews,

I LOLed for your second sentence. 

1) Yes - that is correct. It will work both ways depending on unfilled tags. For example, if iTunes database is missing the TrackNumber for some reason but the actual meta tag has the TrackNumber then iTunes databse will be updated; if the iTunes database shows the TrackNumber is filled but actually it is not written in the file (surprised me - sometimes it happens) then the file will be updated with the TrackNumber. This behavior is intentional. If we require to wipe out the metatags then we can use Mp3tag etc.

2) A classic feature conflict you pointed out there! I have addressed this issue for the next build.

5.60.8.3 Getting string from Pattern truncated strings in brackets for Name tag [jgcrews]

It was done so that when you retrieve %Name% for searching Lyrics, it will maximize search results.

5.60.9.0 Added %BitRate% syntax for getting string from pattern [jgcrews]

3) Very nice FR - feature request. I will add this in the next few builds.

4) Those junk comments turn out to be information for Sound Check that iTunes requires. Sometimes they do get mis-written by other taggers to the normal Comments field so iTSfv's job is to remove those comments. I think you will still see those comments in Mp3tag etc. This whole issue is still a mystery to me. I attempt to address this issue from time to time when I notice unexpected things.

5) That's right. Those files are read by iTSfv to override default behavior. For example, when you capitalize the Artist tag, if it sees "Paul Van Dyk" it will capitalize as "Paul van Dyk" since you have that info in the replace-words.txt. Similar logic applies for other text files there.

Cheers.

iTSfv - iTunes Store file validator

Reply #493
1) Yes - that is correct. It will work both ways depending on unfilled tags. For example, if iTunes database is missing the TrackNumber for some reason but the actual meta tag has the TrackNumber then iTunes databse will be updated; if the iTunes database shows the TrackNumber is filled but actually it is not written in the file (surprised me - sometimes it happens) then the file will be updated with the TrackNumber. This behavior is intentional. If we require to wipe out the metatags then we can use Mp3tag etc.


Is there a way to force the iTunes data to be written as the MP3 tags?  I've come across some instances where the tag data in the actual files differ from the data in the iTunes library - most noticed when exporting files.

5) That's right. Those files are read by iTSfv to override default behavior. For example, when you capitalize the Artist tag, if it sees "Paul Van Dyk" it will capitalize as "Paul van Dyk" since you have that info in the replace-words.txt. Similar logic applies for other text files there.


Are there any rules I should be aware of when adding to the file?  I've pretty much gathered the format appears to be <search string>",,,,"<replacement string> and that is how I've made my additions, but a few don't seem to be getting applied.  One of the things I had done was to try to add all of the variants for "Featuring" (Featuring, featuring, fturing, FT, Ft, Ft., feat., etc) and ensure that they all get replaced with "ft" but somehow I've ended up with several that get replaced with "Ft" or "Ft." and I'm not quite sure why.  Also, is there an order of execution/heirarchy amongst the files as to how the rules are applied - Capital, Simple, Replace?

As always, thanks bunches for your patience and hand holding.  When I get my disability check next month, I'll be making a donation to ensure your efforts continue!  Thanks again.

Jeff

iTSfv - iTunes Store file validator

Reply #494
jgcrews,

Thanks you. I greatly appreciate any affordable donation.

Whenever iTunes data is present and file tags are not, iTunes data will be given higher priority. Similarly, if file tags were present and iTuens data is not, then file tags are given priority. If both file tags and iTunes data are present and has different then file tags are given higher priority. It is currently not possible to force the other way around. This is because the ability to access iTunes data that is not in the tags is very unpredictable. As soon as the file is accessed in iTunes, and the file tags and iTunes db tags differ, iTunes will attempt to refresh the db tags to keep in sync. Then we lose old iTunes db tags. I will see what I can do about this in next beta rounds.

Here is the current hierarchy of the standardizing Capital letters in iTSfv:



It is good you asked; it gave myself a clearer picture of how it worked.

Example:

For An Angel (Featuring  Paul Van Dyk) - EP

For An Angel (Featuring Paul Van Dyk) - EP -- fixed double spacing, EP is preserved (capital-words.txt)
For an Angel (Featuring Paul Van Dyk) - EP -- "An" is now "an" (simple-words.txt)
For an Angel (feat. Paul van Dyk) - EP -- "Featuring" is now "feat." and "Paul Van Dyk" is now "Paul van Dyk" (replace-words.txt)

Cheers,
McoreD.

iTSfv - iTunes Store file validator

Reply #495
If you don't mind running Beta versions that is completely independent from the installer downloaded from SourceForge, I have published a ClickOnce version of iTSfv here:

http://wmwiki.com/mcored/research/itsfv

The advantages are:

The application can automatically update itself so you don't have to download the zip file and install it everytime a new build is posted to SourceForge
ClickOnce versions are published more frequently than betas in SourceForge

5.60.10.0 Extended Export Selected Tracks to optionally also export Artwork if present [jgcrews]
5.60.09.0 Added %BitRate% syntax for getting string from pattern [jgcrews]
5.60.08.3 Getting string from Pattern truncated strings in brackets for Name tag [jgcrews]
5.60.08.2 Fixed possibility where Update Database refreshing tags in file setting could execute if enabled as part of Check Standard in Selected Tracks
5.60.08.1 Prevented possibility where Album Artist, DiscNumber and DiscCount tags were not updated when iTunes erraneously showed these tags were populated

iTSfv - iTunes Store file validator

Reply #496
The heirarchy you provided, as well as some playing around, has helped out.  I thought I had a strange behavior when looking for several variations of "Featuring" and substituting "ft" but it all boiled down to the specific order that I had the variations in the replaced-words file making sure that it wasn't processing the same phrase more than once.

For example: "Featuring" needs to be replaced in the song title and the replace-list was:
"Fturing" --> "ft"
"Feat" --> "ft"
"Featuring" --> "ft"

I kept ending up with the replacement being "Fturing" because of the order in the list.  Moving things around (the list has several more variations) ultimately solved the problem.  The list (for this particular substitution) ended up being:
Featuring,,,,ft
featuring,,,,ft
Fturing,,,,ft
fturing,,,,ft
FEAT,,,,ft
Feat.,,,,ft
feat.,,,,ft
Feat,,,,ft
FT,,,,ft

Then, it took a few tries to realize that "ft" needed to be added as a simple word to keep it from always being changed to "Ft".  The more I learn, the more I respect the effort you have put into iTSfv.

Also regarding the replace-words file, I've realized that I can't simply insert the exact replacement text when it contains foreign characters.  "Annbjorg,,,,Annbjørg" & "Beyonce,,,,Beyoncé" don't work and I have no idea how you arrived at "Tiesto,,,,Tiësto" so is there some tip you can provide me so that this type of substitution I've added works?  As I come across Artist names (similar to this), I want to add the proper substitutions to the replace-words file.

Once again, thanks for your efforts and willingness to address so many issues.  Slap me when you get tired of me! 

iTSfv - iTunes Store file validator

Reply #497
jgcrews,

I am glad things turn out well.

Here is a screenshot of my replace-words.txt



Looks to me your Notepad is not displaying Tiësto properly. Does the replacement for Tiësto work for you within iTSfv?

iTSfv - iTunes Store file validator

Reply #498
Looks to me your Notepad is not displaying Tiësto properly. Does the replacement for Tiësto work for you within iTSfv?


Actually, the original substitution for Tiesto (which came with iTSfv) works as it should.  However, my substitutions don't work.

I put "Tiesto; Bjork; Beyonce" into the artist field of a sample track.  iTSfv replaced it and the results were "Tiësto; BjRk; Beyonc"

My replace-words file is as follows:

`,,,,'
”,,,,"
“,,,,"
–,,,,-
Armin Van Buuren,,,,Armin van Buuren
Ian Van Dahl,,,,Ian van Dahl
Tiesto,,,,Tiësto
Rnb,,,,R&B
Hip Hop,,,,Hip-Hop
Featuring,,,,ft
featuring,,,,ft
Fturing,,,,ft
fturing,,,,ft
FEAT,,,,ft
Feat.,,,,ft
feat.,,,,ft
Feat,,,,ft
FT,,,,ft
Paul Van Dyk,,,,Paul van Dyk
Gigi,,,,GiGi
D´Agostino,,,,d´Agostino
A HA,,,,A-Ha
Ab Logic,,,,AB Logic
Hi Fi,,,,Hi-Fi
Mckee,,,,McKee
Annbjorg,,,,Annbjørg
Audio Slave,,,,Audioslave
B*witched,,,,B*Witched
Bbmak,,,,BBMak
Beyonce,,,,Beyoncé
Bjork,,,,Björk
Bjorn,,,,Björn
Black-Eyed Peas,,,,Black Eyed Peas
Blink 182,,,,Blink-182
Mcferrin,,,,McFerrin
J-kwon,,,,J-Kwon
Jkwon,,,,J-Kwon
Boys Town Gang,,,,Boystown Gang
C-mos,,,,C-Mos
C&C,,,,C & C
C+C,,,,C & C
Cafe Del Mar,,,,Cafe del Mar
Relocate,,,,Re:Locate
Super 8,,,,Super8
D.J.,,,,DJ
_,,,,
FIX8-SED8,,,,fix8:sed8
fix8-sed8,,,,fix8:sed8

As you can see, the substitutions I have added (with special characters) don't work but yours does (as in the case of Tiesto).  I opened the replace-words file using both Metapad and Notepad and the list displays the same in both.


Before:


After:


Any suggestions?

-- Jeff

iTSfv - iTunes Store file validator

Reply #499
Jeff, seems like an encoding error while saving the file.

You shouldn't see Tiësto at any time. You should see Tiësto instead.

Could you check the encoding when you try to perform a Save As in Notepad?



Cheers.