[Perldl] Troubles with CPAN indexing of PDL::NetCDF and

Discussion:

(too old to reply)

Doug Hunt

2011-05-06 21:08:06 UTC

Hi all: I just uploaded a new version (4.13) of PDL::NetCDF with changes
suggested by Sisyphus, Robert Ginko and kmx. None of these seem to have
helped with the cpan shell. It still shows:

------------------------------------------------------------
cpan[2]> get PDL::NetCDF
Running get for module 'PDL::NetCDF'

The module PDL::NetCDF isn't available on CPAN.
------------------------------------------------------------

In addition, I'm no longer getting the email from PAUSE telling of successful
indexing. I think this is because I got rid of the METAMERGE line in
Makefile.PL which adds info the META.yml.

I think I'll put back the META.yml file, but I'm not sure where to go from
there.

--Doug

----- Original Message ----- From: "Doug Hunt"
< Yet under the CPAN shell on

-----------------------------------------------------------------------------
cpan[2]> get PDL::NetCDF
Running get for module 'PDL::NetCDF'
The module PDL::NetCDF isn't available on CPAN.
Either the module has not yet been uploaded to CPAN, or it is
temporary unavailable. Please contact the author to find out
more about the status. Try 'i PDL::NetCDF'.

I get the same on MS Windows (perl-5.12).

Could someone please help me get these two modules to be downloadable via
the cpan shell? Any pointers or hints much appreciated!

Does META.yml serve any vital purpose ?
If not, I'd remove it altogether - it's existence is surely not part of the
solution. (None of my modules include that file.)
You could also try deleting some of those earlier builds (eg
PDL::NetCDF-4.05 and earlier). They'll still be available on backpan,
anyway ... and it'd be interesting to see whether the 'i PDL::NetCDF'
output then changes.
On top of that, I'm not even sure that there's much to be gained by having
PDL::NetCDF/PDL::Graphics::PLplot obtainable via the CPAN module. Any one
who wants either of those modules is probably just as happy to download and
install manually.
And it's unlikely that the cpan-testers have plplot or netcdf installed -
so there's nothing to be gained by making those modules available to them
via cpan either.
Still ... it'd be better if 'cpan -i' *did* work as advertised ... and if I
had a half-decent idea as to why that's not happening, I'd share it with
you :-)
Cheers,
Rob

_______________________________________________
Perldl mailing list
http://mailman.jach.hawaii.edu/mailman/listinfo/perldl

(Andreas J. Koenig)

2011-05-16 06:12:57 UTC

Permalink

Post by Doug Hunt
I think I'll put back the META.yml file, but I'm not sure where to go
from there.

Since your distro has no *.pm file the indexer on PAUSE cannot index it
without your help. You must provide a META.yml and it must contain a
provides entry.

I suggest you do that and if it again does not work, contact me to debug
it. Offhand I cannot see the reason why it did not work and I cannot
debug it because 4.13 has no META.yml with a provides entry.

--
andreas

Doug Hunt

2011-05-16 16:35:05 UTC

Permalink

Hi Andreas: I tried that earlier and got only mixed success. I did get
an email from CPAN that it had indexed it which listed the correct
version.

I still was not able to install the module via the cpan shell. For the
next release, I'll put META.yml back in and submit it. If it still does
not work, I'll email you.

Thanks!

--Doug Hunt

***@ucar.edu
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by (Andreas J. Koenig)

Post by Doug Hunt
I think I'll put back the META.yml file, but I'm not sure where to go
from there.

Since your distro has no *.pm file the indexer on PAUSE cannot index it
without your help. You must provide a META.yml and it must contain a
provides entry.
I suggest you do that and if it again does not work, contact me to debug
it. Offhand I cannot see the reason why it did not work and I cannot
debug it because 4.13 has no META.yml with a provides entry.
--
andreas

Ivan Shmakov

2011-11-27 08:48:20 UTC

Permalink

[âŠ]

Post by (Andreas J. Koenig)
I suggest you do that and if it again does not work, contact me to
debug it. Offhand I cannot see the reason why it did not work and I
cannot debug it because 4.13 has no META.yml with a provides entry.

Hi Andreas: I tried that earlier and got only mixed success. I did
get an email from CPAN that it had indexed it which listed the
correct version.
I still was not able to install the module via the cpan shell. For
the next release, I'll put META.yml back in and submit it. If it
still does not work, I'll email you.

Any progress on this one?

TIA.

cpan> i PDL::NetCDF
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_USERID DHUNT (Douglas Hunt <***@ucar.edu>)
CPAN_VERSION undef
CPAN_FILE Contact Author Douglas Hunt <***@ucar.edu>
DSLIP_STATUS RdcOp
(released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)

cpan>

$ zgrep -EA9 -- ^File:\|PDL::NetCDF .cpan/sources/modules/03modlist.data.gz
File: 03modlist.data
Description: These are the data that are published in the module
list, but they may be more recent than the latest posted
modulelist. Over time we'll make sure that these data
can be used to print the whole part two of the
modulelist. Currently this is not the case.
Modcount: 6232
Written-By: PAUSE version 1.14
Date: Sat, 26 Nov 2011 19:27:43 GMT

--
'PDL::NetCDF',
'R',
'd',
'c',
'O',
'p',
'Reads/Writes NetCDF files from/to PDL objs',
'DHUNT',
'6'
],
$

(No mention of the module in modules/02packages.details.txt.gz.)

--
FSF associate member #7257

(Andreas J. Koenig)

2011-11-27 21:30:44 UTC

Permalink

Post by Ivan Shmakov
[…]

Hi Andreas: I tried that earlier and got only mixed success. I did
get an email from CPAN that it had indexed it which listed the
correct version.
I still was not able to install the module via the cpan shell. For
the next release, I'll put META.yml back in and submit it. If it
still does not work, I'll email you.

Any progress on this one?

I see another upload has happened:

31256 2011-08-08 DHUNT/PDL-NetCDF-4.14.tar.gz

But the content is again without a PDL/NetCDF.pm file and the META.yml
has no "provides" entry. Without either of those the indexing will not
happen. If you want to install it you must say (if you're using the cpan
shell):

cpan> install DHUNT/PDL-NetCDF-4.14.tar.gz

You can inform yourself about newer uploads with

cpan> ls DHUNT/PDL-NetCDF*

--
andreas

Doug Hunt

2011-11-28 20:15:16 UTC

Permalink

Hi Andreas:

I've added 'provides' in META.yml in the past. I've even got promising
looking emails from CPAN saying that PDL::NetCDF had been indexed under
the correct version. Still CPAN installs seem not to work.

I just made an update to PDL::NetCDF to bump its version to 4.15. I've
included a META_MERGE tag in the call to WriteMakefile which produces
the following META.yml:

------------------%<---------------------------------------------------
--- #YAML:1.0
name: PDL-NetCDF
version: 4.15
abstract: ~
author:
- Douglas Hunt (***@ucar.edu)
license: unknown
distribution_type: module
configure_requires:
ExtUtils::MakeMaker: 0
build_requires:
ExtUtils::MakeMaker: 0
requires:
PDL: 2.2
provides:
PDL::NetCDF:
file: netcdf.pd
version: 4.15
no_index:
directory:
- t
- inc
generated_by: ExtUtils::MakeMaker version 6.56
meta-spec:
url: http://module-build.sourceforge.net/META-spec-v1.4.html
version: 1.4
------------------%<---------------------------------------------------

Does this look right to you? If so, I'll submit this to CPAN and see what
happens.

Thanks!

--Doug Hunt

***@ucar.edu
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by (Andreas J. Koenig)

Post by Ivan Shmakov
[?]

Hi Andreas: I tried that earlier and got only mixed success. I did
get an email from CPAN that it had indexed it which listed the
correct version.
I still was not able to install the module via the cpan shell. For
the next release, I'll put META.yml back in and submit it. If it
still does not work, I'll email you.

Any progress on this one?

31256 2011-08-08 DHUNT/PDL-NetCDF-4.14.tar.gz
But the content is again without a PDL/NetCDF.pm file and the META.yml
has no "provides" entry. Without either of those the indexing will not
happen. If you want to install it you must say (if you're using the cpan
cpan> install DHUNT/PDL-NetCDF-4.14.tar.gz
You can inform yourself about newer uploads with
cpan> ls DHUNT/PDL-NetCDF*
--
andreas
_______________________________________________
Perldl mailing list
http://mailman.jach.hawaii.edu/mailman/listinfo/perldl

(Andreas J. Koenig)

2011-11-28 21:24:50 UTC

Permalink

Post by Doug Hunt
[...]
file: netcdf.pd
version: 4.15
[...]
------------------%<---------------------------------------------------
Does this look right to you? If so, I'll submit this to CPAN and see
what happens.

Yes, this looks familiar to me, please try it out and complain
immediately to me if it doesn't work.

Post by Doug Hunt
Thanks!

You're welcome!

--
andreas

Doug Hunt

2011-11-28 23:05:05 UTC

Permalink

Hi again, Andreas!

I submitted this an hour or so ago. I got this reassuring email from
PAUSE:

------------------%<-----------------------------------------------------------
The following report has been written by the PAUSE namespace indexer.
Please contact ***@perl.org if there are any open questions.

User: DHUNT (Douglas Hunt)
Distribution file: PDL-NetCDF-4.15.tar.gz
Number of files: 13
*.pm files: 0
README: PDL-NetCDF-4.15/README
META.yml: PDL-NetCDF-4.15/META.yml
YAML-Parser: YAML::XS 0.32
META-driven index: yes
Timestamp of file: Mon Nov 28 21:58:52 2011 UTC
Time of this run: Mon Nov 28 22:00:27 2011 UTC

Status of this distro: OK
=========================

The following packages (grouped by status) have been found in the distro:

Status: Successfully indexed
============================

module: PDL::NetCDF
version: 4.15
in file: netcdf.pd
status: indexed

__END__
------------------%<-----------------------------------------------------------

but I still don't see an index from cpan:

------------------%<-----------------------------------------------------------
nolock_cpan[2]> i /PDL::NetCDF/
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_USERID DHUNT (Douglas Hunt <***@ucar.edu>)
CPAN_VERSION undef
CPAN_FILE Contact Author Douglas Hunt <***@ucar.edu>
DSLIP_STATUS RdcOp
(released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)

(as opposed to, for example):
nolock_cpan[3]> i /Term::ReadLine::Perl/
Module id = Term::ReadLine::Perl
DESCRIPTION GNU Readline history and completion in Perl
CPAN_USERID ILYAZ (Ilya Zakharevich <***@ilyaz.org>)
CPAN_VERSION 1.0303
CPAN_FILE I/IL/ILYAZ/modules/Term-ReadLine-Perl-1.0303.tar.gz
DSLIP_STATUS RdpO? (released,developer,perl,object-oriented,)
INST_FILE (not installed)
------------------%<-----------------------------------------------------------

So, I think I'm stuck where I've always been.

Any ideas or suggestions welcome!

Regards,

Doug

***@ucar.edu
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by (Andreas J. Koenig)

Yes, this looks familiar to me, please try it out and complain
immediately to me if it doesn't work.

Post by Doug Hunt
Thanks!

You're welcome!
--
andreas

David Mertens

2011-11-29 00:07:32 UTC

Permalink

Doug, all -

To be clear, when I fire up CPAN and type the command you supply, I get
this output:

cpan[1]> i /PDL::NetCDF/
CPAN: Storable loaded ok (v2.27)
Reading '/home/visitors/dcmertens/.cpan/Metadata'
Database was generated on Tue, 08 Nov 2011 06:29:47 GMT
CPAN: LWP::UserAgent loaded ok (v6.02)
CPAN: Time::HiRes loaded ok (v1.972101)
Fetching with LWP:
http://cpan.msi.umn.edu/authors/01mailrc.txt.gz
Reading '/home/visitors/dcmertens/.cpan/sources/authors/01mailrc.txt.gz'
CPAN: Compress::Zlib loaded ok (v2.033)
............................................................................DONE
Fetching with LWP:
http://cpan.msi.umn.edu/modules/02packages.details.txt.gz
Reading
'/home/visitors/dcmertens/.cpan/sources/modules/02packages.details.txt.gz'
* Database was generated on Mon, 28 Nov 2011 06:29:30 GMT
*
............................................................................DONE
Fetching with LWP:
http://cpan.msi.umn.edu/modules/03modlist.data.gz
Reading '/home/visitors/dcmertens/.cpan/sources/modules/03modlist.data.gz'
............................................................................DONE
Writing /home/visitors/dcmertens/.cpan/Metadata
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_USERID DHUNT (Douglas Hunt <***@ucar.edu>)
CPAN_VERSION undef
CPAN_FILE Contact Author Douglas Hunt <***@ucar.edu>
DSLIP_STATUS RdcOp (released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)

Notice the emphasized line. If I understand this correctly, this means that
the packages file was last updated this mornig at 06:29:30, GMT. I believe
that if you check back after the package list has been updated to a
time-stamp after you submitted the new module, it should have the correct
information.

David

I could be wrong here, but I was under the impression that it can take
many hours for the various CPAN mirrors to update. How much time did you
give them to update?
David

Post by Doug Hunt
Hi again, Andreas!
I submitted this an hour or so ago. I got this reassuring email from
------------------%<----------**------------------------------**
-------------------
The following report has been written by the PAUSE namespace indexer.
User: DHUNT (Douglas Hunt)
Distribution file: PDL-NetCDF-4.15.tar.gz
Number of files: 13
*.pm files: 0
README: PDL-NetCDF-4.15/README
META.yml: PDL-NetCDF-4.15/META.yml
YAML-Parser: YAML::XS 0.32
META-driven index: yes
Timestamp of file: Mon Nov 28 21:58:52 2011 UTC
Time of this run: Mon Nov 28 22:00:27 2011 UTC
Status of this distro: OK
=========================
Status: Successfully indexed
============================
module: PDL::NetCDF
version: 4.15
in file: netcdf.pd
status: indexed
__END__
------------------%<----------**------------------------------**
-------------------
------------------%<----------**------------------------------**
-------------------
nolock_cpan[2]> i /PDL::NetCDF/
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_VERSION undef
DSLIP_STATUS RdcOp (released,developer,C,object-**
oriented,Standard-Perl)
INST_FILE (not installed)
nolock_cpan[3]> i /Term::ReadLine::Perl/
Module id = Term::ReadLine::Perl
DESCRIPTION GNU Readline history and completion in Perl
CPAN_VERSION 1.0303
CPAN_FILE I/IL/ILYAZ/modules/Term-**ReadLine-Perl-1.0303.tar.gz
DSLIP_STATUS RdpO? (released,developer,perl,**object-oriented,)
INST_FILE (not installed)
------------------%<----------**------------------------------**
-------------------
So, I think I'm stuck where I've always been.
Any ideas or suggestions welcome!
Regards,
Doug
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by Doug Hunt

Post by Doug Hunt
[...]
file: netcdf.pd
version: 4.15
[...]
------------------%<----------**------------------------------**

-----------

Post by Doug Hunt
Does this look right to you? If so, I'll submit this to CPAN and see
what happens.

Yes, this looks familiar to me, please try it out and complain
immediately to me if it doesn't work.

Post by Doug Hunt
Thanks!

You're welcome!
--
andreas

______________________________**_________________
Perldl mailing list
http://mailman.jach.hawaii.**edu/mailman/listinfo/perldl<http://mailman.jach.hawaii.edu/mailman/listinfo/perldl>

--
Sent via my carrier pigeon.

Doug Hunt

2011-11-29 16:13:54 UTC

Permalink

Hi David: OK, thanks--I'll wait until tomorrow to check 'cpan'.

--Doug

***@ucar.edu
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by David Mertens
Doug, all -
cpan[1]> i /PDL::NetCDF/
CPAN: Storable loaded ok (v2.27)
Reading '/home/visitors/dcmertens/.cpan/Metadata'
Database was generated on Tue, 08 Nov 2011 06:29:47 GMT
CPAN: LWP::UserAgent loaded ok (v6.02)
CPAN: Time::HiRes loaded ok (v1.972101)
http://cpan.msi.umn.edu/authors/01mailrc.txt.gz
Reading '/home/visitors/dcmertens/.cpan/sources/authors/01mailrc.txt.gz'
CPAN: Compress::Zlib loaded ok (v2.033)
............................................................................DONE
http://cpan.msi.umn.edu/modules/02packages.details.txt.gz
Reading '/home/visitors/dcmertens/.cpan/sources/modules/02packages.details.txt.gz'
Database was generated on Mon, 28 Nov 2011 06:29:30 GMT
............................................................................DONE
http://cpan.msi.umn.edu/modules/03modlist.data.gz
Reading '/home/visitors/dcmertens/.cpan/sources/modules/03modlist.data.gz'
............................................................................DONE
Writing /home/visitors/dcmertens/.cpan/Metadata
Module id = PDL::NetCDF
    DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
    CPAN_VERSION undef
    DSLIP_STATUS RdcOp (released,developer,C,object-oriented,Standard-Perl)
    INST_FILE    (not installed)
Notice the emphasized line. If I understand this correctly, this means that the packages file was last updated this mornig at
06:29:30, GMT. I believe that if you check back after the package list has been updated to a time-stamp after you submitted the
new module, it should have the correct information.
David
I could be wrong here, but I was under the impression that it can take many hours for the various CPAN mirrors to
update. How much time did you give them to update?
David
Hi again, Andreas!
------------------%<-----------------------------------------------------------
The following report has been written by the PAUSE namespace indexer.
User: DHUNT (Douglas Hunt)
Distribution file: PDL-NetCDF-4.15.tar.gz
Number of files: 13
*.pm files: 0
README: PDL-NetCDF-4.15/README
META.yml: PDL-NetCDF-4.15/META.yml
YAML-Parser: YAML::XS 0.32
META-driven index: yes
Timestamp of file: Mon Nov 28 21:58:52 2011 UTC
Time of this run: Mon Nov 28 22:00:27 2011 UTC
Status of this distro: OK
=========================
Status: Successfully indexed
============================
module: PDL::NetCDF
version: 4.15
in file: netcdf.pd
status: indexed
__END__
------------------%<-----------------------------------------------------------
------------------%<-----------------------------------------------------------
nolock_cpan[2]> i /PDL::NetCDF/
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_VERSION undef
DSLIP_STATUS RdcOp (released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)
nolock_cpan[3]> i /Term::ReadLine::Perl/
Module id = Term::ReadLine::Perl
DESCRIPTION GNU Readline history and completion in Perl
CPAN_VERSION 1.0303
CPAN_FILE I/IL/ILYAZ/modules/Term-ReadLine-Perl-1.0303.tar.gz
DSLIP_STATUS RdpO? (released,developer,perl,object-oriented,)
INST_FILE (not installed)
------------------%<-----------------------------------------------------------
So, I think I'm stuck where I've always been.
Any ideas or suggestions welcome!
Regards,
Doug
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611
On Mon, 28 Nov 2011 13:15:16 -0700 (MST),
> [...]
> file: netcdf.pd
> version: 4.15
> [...]
> ------------------%<---------------------------------------------------
> Does this look right to you? If so, I'll submit this to CPAN and see
> what happens.
Yes, this looks familiar to me, please try it out and complain
immediately to me if it doesn't work.
> Thanks!
You're welcome!
--
andreas
_______________________________________________
Perldl mailing list
http://mailman.jach.hawaii.edu/mailman/listinfo/perldl
--
Sent via my carrier pigeon.
--
Sent via my carrier pigeon.

(Andreas J. Koenig)

2011-11-29 07:01:05 UTC

Permalink

I found (and removed[0]) a long forgotten sanity check in the pause
indexer which prevented the inclusion into 02packages.details.txt, the
file that publishes the index and now, finally, I see

% grep NetCDF /home/ftp/pub/PAUSE/modules/02packages.details.txt
PDL::NetCDF 4.15 D/DH/DHUNT/PDL-NetCDF-4.15.tar.gz

And I can ask the CPAN shell:

cpan[6]> m PDL::NetCDF
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_USERID DHUNT (Douglas Hunt <***@ucar.edu>)
CPAN_VERSION 4.15
CPAN_FILE D/DH/DHUNT/PDL-NetCDF-4.15.tar.gz
UPLOAD_DATE 2011-11-28
DSLIP_STATUS RdcOp (released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)

Thanks for not giving up on this one!

And sorry for the mess,

--
andreas

[0]
https://github.com/andk/pause/commit/ae6379f6a49cc640679821522cab5da10f5e5482

Doug Hunt

2011-11-29 16:15:53 UTC

Permalink

WooHoo!

--Doug

***@ucar.edu
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by (Andreas J. Koenig)
I found (and removed[0]) a long forgotten sanity check in the pause
indexer which prevented the inclusion into 02packages.details.txt, the
file that publishes the index and now, finally, I see
% grep NetCDF /home/ftp/pub/PAUSE/modules/02packages.details.txt
PDL::NetCDF 4.15 D/DH/DHUNT/PDL-NetCDF-4.15.tar.gz
cpan[6]> m PDL::NetCDF
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_VERSION 4.15
CPAN_FILE D/DH/DHUNT/PDL-NetCDF-4.15.tar.gz
UPLOAD_DATE 2011-11-28
DSLIP_STATUS RdcOp (released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)
Thanks for not giving up on this one!
And sorry for the mess,
--
andreas
[0]
https://github.com/andk/pause/commit/ae6379f6a49cc640679821522cab5da10f5e5482

Doug Hunt

2011-11-29 21:17:35 UTC

Permalink

Hi again, Andreas:

After the latest mirror update, now my cpan command shows the correct
index:

$ cpan

...

cpan[2]> reload index
CPAN: Storable loaded ok (v2.22)
Going to read '/home/cosmicops/.cpan/Metadata'
Database was generated on Tue, 29 Nov 2011 03:32:34 GMT

...

cpan[3]> i /PDL::NetCDF/
Module id = PDL::NetCDF
DESCRIPTION Reads/Writes NetCDF files from/to PDL objs
CPAN_USERID DHUNT (Douglas Hunt <***@ucar.edu>)
CPAN_VERSION 4.15
CPAN_FILE D/DH/DHUNT/PDL-NetCDF-4.15.tar.gz
DSLIP_STATUS RdcOp
(released,developer,C,object-oriented,Standard-Perl)
INST_FILE (not installed)

Very cool! I've been fighting this problem for some months now.

Thanks, Andreas!

--Doug

***@ucar.edu
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611

Post by Doug Hunt
WooHoo!
--Doug
Software Engineer
UCAR - COSMIC, Tel. (303) 497-2611