Wikisource:Bot requests

←Community pages

Bot requests

archives (current)→

This page allows users to request that an existing bot accomplish a given task. Note that some tasks may require that an entirely new bot or script be written. This is not the place to ask for help running or writing a bot. A bot operating performing a task should make note of it so that other bots don't attempt to do the same. Tasks that are permanently assigned or scheduled for long-term execution are listed on Persistent tasks. See also Wikisource:Bots

Unassigned requests

Archive Bot

RE Wikisource:Scriptorium#Split.3F would anyone be interested in cloning the archive function of user:sanbeg (bot)? It had been archiving Scriptorium, but has been inconsistent for sometime. JeepdaySock (AKA, Jeepday) 15:51, 8 February 2013 (UTC)

When Validated

I made a suggestion at Wikisource:Scriptorium#When_Validated for a categorization by month and year that a work is validated. Adam suggested that this would require a bot, to search for and add works to the categories. Is there anyone who would/could be interested in this ongoing task? Jeepday (talk) 01:06, 31 March 2013 (UTC)

Hi. One solution is to use a query, setting start and end date (change the bold fields in cmstart=2013-02-01T00%3A00%3A00Z&cmend=2013-02-28T00%3A00%3A00Z). And then categorize manually. See below.--Mpaa (talk) 15:34, 2 April 2013 (UTC)

See e.g. for Index validated in February:

• http://en.wikisource.org/w/api.php?action=query&list=categorymembers&format=xml&cmtitle=Category%3AIndex%20Validated&cmprop=title%7Ctimestamp&cmlimit=100&cmsort=timestamp&cmdir=ascending&cmstart=2013-02-01T00%3A00%3A00Z&cmend=2013-02-28T00%3A00%3A00Z

Or you can use the API Sandbox as interface and select the output format you prefer:

• https://en.wikisource.org/wiki/Special:ApiSandbox#action=query&list=categorymembers&format=xml&cmtitle=Category%3AIndex%20Validated&cmprop=title%7Ctimestamp&cmlimit=100&cmsort=timestamp&cmdir=ascending&cmstart=2013-02-01T00%3A00%3A00Z&cmend=2013-02-28T00%3A00%3A00Z

• Withdraw request, a lot of work, with limited community support. JeepdaySock (AKA, Jeepday) 14:58, 8 April 2013 (UTC)

  Actually, I might be able to do this. I can't do complicated bot stuff but it occurred to me recently that this might be possible with AutoWikiBrowser. It helps that most of the the validations appear to fall in December 2012 (I don't know why but 594 out of 993 have this date, as at time of writing). I think a template might work best; I've noticed categories sometimes get removed from index pages when they are edited. I still need to think about how to do that. However, this won't cover future validations, this would have to be done semi-regularly to keep everything up to date (and could be done manually in some months). - AdamBMorgan (talk) 20:42, 8 April 2013 (UTC)

I do not know how you got December, but I noticed that too using the query above and removing the time interval or e.g

<DynamicPageList>
category             = Index Validated
addfirstcategorydate = true
order                = descending
</DynamicPageList>

To me, it looks strange, as I checked at random and the history does not match with the indicated December timestamp.

Maybe someone more knowledgeable in queries might explain why?

A possible brute force approach is to run a bot to scan the revisions of the validated indexes and check when progress changed to "validated". I can't promise when but I might give it a try.--Mpaa (talk) 22:14, 8 April 2013 (UTC)

There was an edit to MediaWiki:Proofreadpage index template, the page that controls all Index pages, at about the same time (2012-12-16 00:21Z). That might have affected the categorisation. I know Dynamic Page List, and probably the API, records the last time a page was added to a category, not the first time. - AdamBMorgan (talk) 08:53, 9 April 2013 (UTC)

If someone is interested, here is the list. Dates indicate when Progress has been set to "Done". I made some spot checks and should be OK.--Mpaa (talk) 20:15, 9 April 2013 (UTC)

That's great! My idea for implementation was to add a template like {{index validated date}}, still experimental at the moment, to each index in the table of contents section (just so it is in the index page somewhere, not left the end where it might get lost if the page is edited, and in a location that shouldn't interfere with anything else). I can add the template in blocks for each month with an automated search and replace, although even then it wouldn't be quick. I have made a live test on Index:Frontiers.djvu (which is apparently our first ever complete index). The top icon is just to easily and quickly identify indexes with or without this template; it can be removed if it is a problem. - AdamBMorgan (talk) 21:42, 9 April 2013 (UTC)

Great job ! Jeepday (talk) 10:07, 10 April 2013 (UTC)

Once you're done with experimenting and what is wanted is settled and agreed, we could see how to handle the changes in a more automated way.--Mpaa (talk) 12:08, 10 April 2013 (UTC)

I've made an initial run through a few months, all sorted into subcategories of Category:Indexes validated by date. I'm just going to wait for a bit to see if this is working, correct and that I haven't broken anything. If there are no complaints, I'll finish the task soon. - AdamBMorgan (talk) 00:54, 14 April 2013 (UTC)

Great start Adam, umm User:Robbie the Robot might want to drop a note here before doing to much more. Just to keep with the formalities. Jeepday (talk) 11:31, 14 April 2013 (UTC)

Will do. (To be honest, I thought that wasn't necessary if it was listed on the page. However, as lots of people will see these edits, I suppose some information is appropriate). - AdamBMorgan (talk) 09:34, 15 April 2013 (UTC)

Done See Category:Indexes validated by date (I've also made a portal, Portal:Proofreading milestones, for the key validations). - AdamBMorgan (talk) 01:08, 17 April 2013 (UTC)

Add to persistent tasks

Can this task be added to the list of /Persistent tasks? It can be performed by any AWB-based bot, any AWB user or even manually (although this last one may be a lot of work in some months). The task will need to be performed at least monthly to keep the categories up to date. - AdamBMorgan (talk) 12:13, 18 April 2013 (UTC)

Volume information for CE1913

As was done with Wikisource:Bot requests/Archives/2012#Volume information for EB1911 2 can a bot add volume information added to the header or the article pages of CE1913.

This has been done by hand for some entries (eg the first in the encyclopaedia Catholic Encyclopedia (1913)/Aachen) but has not been done for entries such as Catholic Encyclopedia (1913)/Good Friday

In addition it would be nice to have the contributor field filled out as it is for the "Aachen" entry but has not been done for the "Good Friday" example. But I appreciate that this is more complicated and perhaps the two processes should be done independently of each other.

-- PBS (talk) 11:22, 20 April 2013 (UTC)

Is there a volume list? — billinghurst sDrewth 11:26, 20 April 2013 (UTC)

Regarding the contributor, is there at least a list of contributors per article (asking for too much maybe), or how they are usually indicated in text? E.g. A.A. MACERLEAN = Andrew Alphonsus MacErlean, so one can try to make some match at least?--Mpaa (talk) 11:56, 20 April 2013 (UTC)

In the meantime I started with pages with contributors.--Mpaa (talk) 18:43, 20 April 2013 (UTC)

Done for pages with contributors, when linked to /Volume N. There is a bunch of pages not linked anywhere. The rest is on hold, pending the decision to set up info on contributors or continue and take the two steps in two different runs.--Mpaa (talk) 22:23, 21 April 2013 (UTC)

NB that the initial Catholic Encyclopedia posting is a right mess. A number of quite arbitrary decisions were made, some of them dating back to the New Advent digitisation. The volume listings we have here are essentially worthless. They are quite untrustworthy, and if I need to know a volume number, I would always consult http://oce.catholic.com/ where you can see the pages and their order. I have worked through volume 1 here, and volume 2 up to Benedict Biscop, only. Other than that, there is no reason to believe that the article titles are sensible or correct or standard, or that "previous" and "next" are correct links.

If there is interest now in doing it right, the page WS:CEU and its talk are available. Creating the author pages is semi-routine from The Catholic Encyclopedia and its Makers. Dates of death can present a problem. The article listings in that work are quirky and often not quite complete. Charles Matthews (talk) 07:37, 22 April 2013 (UTC)

OK, I'll will not proceed further then. Note that there could be the chance to add contributors on articles, based on their signature at the end of an article. If someone is interested, just leave a note. --Mpaa (talk) 09:42, 22 April 2013 (UTC)

That sounds to be of interest. The signatures do require checking: some are in bad shape. Charles Matthews (talk) 15:04, 22 April 2013 (UTC)

I'll post at WS:CEU talk page what I have in mind.--Mpaa (talk) 21:41, 22 April 2013 (UTC)

A Dictionary of Music and Musicians (new requests)

With the need to change from the DL format there are a few tasks that I need bot assistance with.

1. Change all internal links of the format [[A Dictionary of Music and Musicians/B#Beethoven, Ludwig van|{{sc|Beethoven}}]] to [[../Beethoven, Ludwig van|{{sc|Beethoven}}]]. These will be found in Index:A Dictionary of Music and Musicians vol 1.djvu and Index:A Dictionary of Music and Musicians vol 4.djvu.

done--Mpaa (talk) 22:58, 31 May 2013 (UTC)

2. Create subpage articles for all articles in Index:A Dictionary of Music and Musicians vol 1.djvu pp. 13 to 780 and Index:A Dictionary of Music and Musicians vol 4.djvu pp. 533 to 700. Please use {{DMM}} for the header. The subpage name for each article will be the name in the section tags. The content for the Contributor = field will be found in the Author: link at the end of each article. Previous = & Next = will be from the section tags of the previous and next article in sequence in the volume. Articles from volume 4 should have "Published in the Appendix" in the Notes = field. Make the Wikipedia = field the subpagename and the DMM project will go through them and amend or remove links as appropriate.

Regarding Wikipedia = , do you mean to use {{SUBPAGENAME}}? I guess not many pages on Wikipedia are named "Surname, Name". Wouldn't it be better to try to reverse the section tag to "Name Surname"?--Mpaa (talk) 08:20, 1 June 2013 (UTC)

You're quite right (of course). Thanks for catching that! Beeswaxcandle (talk) 08:29, 1 June 2013 (UTC)

Created a few under A. Can you take a look if it's OK like this?--Mpaa (talk) 12:19, 1 June 2013 (UTC)

They look fine to me. Much appreciated. Beeswaxcandle (talk) 22:29, 1 June 2013 (UTC)

Hi again. One more check before proceeding further. Prev/next for Vol 1 should be based on Vol 1 and Vol 1 only or consider also Vol. 4 entries? Current bot is considering only Vol 1, as you can see from red entries here, A, where articles from Appendix are not part f the prev/next sequence.--Mpaa (talk) 18:49, 2 June 2013 (UTC)

Stick to current with the sequence per volume. The alphabet structure at 1:1 ... is a construct that isn't a part of the work as published and is just intended to make navigation easier. Thanks, Beeswaxcandle (talk) 22:24, 2 June 2013 (UTC)

A couple of refinements that would be nice, but not essential if not practical. 1) If score tags are present in the article, then set Score = to yes. 2) If ref tags are present in the article, then add {{smallrefs}} after the pages command. 3) Include Type = on all articles, but leave blank (filling this in has to be done by a human). Beeswaxcandle (talk) 04:50, 3 June 2013 (UTC)

Articles in Vol. 1 created.--Mpaa (talk) 18:43, 5 June 2013 (UTC)

Articles in Vol. 4 created.--Mpaa (talk) 19:13, 6 June 2013 (UTC)

3. Create a list of all articles created through #2 above for the letters H & I at Wikisource:Wikiproject DMM/H and Wikisource:Wikiproject DMM/I Many thanks, Beeswaxcandle (talk) 08:48, 31 May 2013 (UTC)

List of DL, as done before, for H and I now in Wikisource:Wikiproject DMM/H. Let me know if I got you wrongly.--Mpaa (talk) 08:45, 1 June 2013 (UTC)

Bible Bulk Moves

In Index:The Holy Bible, containing the Old & New Testament & the Apocrypha (Volume 3).djvu, we need every page currently existing in the range

• D/652 to D/1478 moved up by +2 [new range: D/654 to D/1480]

Thanks in advance (... and I don't know why folks can't follow instructions). -- George Orwell III (talk) 11:07, 14 June 2013 (UTC)

Done --Mpaa (talk) 16:23, 14 June 2013 (UTC)

Assigned requests

For noting {{PD-old}}

A quick note to say that I have been running Sdrewthbot through Author: ns pages for those authors listed as dying between 1880-1912 and either adding the licence if it doesn't have a licence, or converting any that don't say PD-old to be using that licence. — billinghurst sDrewth 07:16, 1 January 2013 (UTC)

Migrating from {{edition}} to edition = y

There are 4k+ pages that transclude {{edition}}. I am considering using my bot to run through and rm the template and add the parameter line edition = y to those pages' {{header}}. Checking the attitude of the community to this proposed bot run. — billinghurst sDrewth

Just been doing some tests and found at least one anomaly. Found that Gettysburg Address had {{versions}} and {{edition}} which would seem to be a dichotomy. This is probably a case of the main ns page being moved and the talk page being left behind. Initially I updated the versions template, which I quickly rolled back for the preceding reason. I would think that there will probably be similar situations with {{disambiguation}} in which I would think that the same logic of the display of edition would be incongruous. I will still undertake their replacement to the edition parameter, however they will not display unless we choose to make them display by updating the templates, and this will also apply to the these subsidiary templates of header. about 50-70 templates — billinghurst sDrewth 06:19, 27 January 2013 (UTC)

Though not documented, found that {{edition}} takes the parameter title= as used in National Geographic Magazine/Volume 31/Number 6/Our State Flowers/The Mountain Laurel. Skipping these for example work, and probably in any first batch of the replacement run. — billinghurst sDrewth 07:25, 27 January 2013 (UTC)

Notification of forthcoming job — Category:No reference tag

A while back I did some tagging of reference errors, and the WMF task bot has finally caught up. For the main namespace pages in Category:No reference tag, I am planning to append the pages with {{smallrefs}}, either at the end of if it is just a transclusion, or before a copyright tag if it exists on the page. Other pages in the category will just be skipped at this time, and will be revisited. If there is any reason to hold off, or requests, or suggestions, please let me know. — billinghurst sDrewth 13:07, 17 February 2013 (UTC)

Should it be also before Categories, if any?--Mpaa (talk) 13:21, 17 February 2013 (UTC)

My mental + blah blah didn't make it to the page. Caught in an iterative loop elsewhere. Yes, that was my meaning. — billinghurst sDrewth 13:35, 17 February 2013 (UTC)

• Persistent or scheduled bot tasks are tracked on Persistent tasks.