/[metamod]/trunk/harvest
ViewVC logotype

Log of /trunk/harvest

View Directory Listing Directory Listing


Sticky Revision:

Revision 2658 - Directory Listing
Modified Tue May 20 14:12:55 2014 UTC (6 years, 2 months ago) by geira
more options to specify master config path

Revision 2611 - Directory Listing
Modified Thu Jan 30 14:01:22 2014 UTC (6 years, 6 months ago) by geira
cleaned up a lot of trailing newlines in debug output

Revision 2290 - Directory Listing
Modified Tue Nov 6 13:24:16 2012 UTC (7 years, 9 months ago) by egils
Avoided writing deleted datasets if they dont exist

Revision 2161 - Directory Listing
Modified Tue Jan 31 13:40:45 2012 UTC (8 years, 6 months ago) by egils
Merged in r2096 (typo in resumptiontoken) from branches/2.9

Revision 2158 - Directory Listing
Modified Wed Jan 25 16:35:27 2012 UTC (8 years, 6 months ago) by geira
fix for undef warning when GET fails

Revision 2135 - Directory Listing
Modified Mon Jan 9 18:10:58 2012 UTC (8 years, 7 months ago) by geira
added startup msg

Revision 2055 - Directory Listing
Modified Fri Oct 7 10:44:14 2011 UTC (8 years, 10 months ago) by oysteint
Removed more of the quadtree support and removed the quadtreeuse module.

Revision 2024 - Directory Listing
Modified Wed Oct 5 15:31:15 2011 UTC (8 years, 10 months ago) by geira
minor init and usage cleanup

Revision 2021 - Directory Listing
Modified Wed Oct 5 13:58:25 2011 UTC (8 years, 10 months ago) by oysteint
Update to standard commandline interace for config.

Revision 1935 - Directory Listing
Modified Thu Sep 8 10:36:49 2011 UTC (8 years, 11 months ago) by oysteint
Merged in changes from branches/remove_target

Revision 1822 - Directory Listing
Modified Thu Jun 30 15:58:11 2011 UTC (9 years, 1 month ago) by geira
MAJOR CHANGES TO IMPORTS
* harvester now using crontab-like scheduling (via POE)
* upload_monitor rewritten to using event queue, now handles only web uploads
* ftp processing moved to new daemon ftp_monitor (soon to implement POE scheduling)


Revision 1775 - Directory Listing
Modified Thu Jun 16 08:44:30 2011 UTC (9 years, 1 month ago) by geira
added "has" method to check if config directive exists (return true/false)
cleaned up log msgs

Revision 1633 - Directory Listing
Modified Wed Apr 6 11:22:01 2011 UTC (9 years, 4 months ago) by geira
all perl scripts set executable so can run from src

Revision 934 - Directory Listing
Modified Fri Oct 8 12:52:48 2010 UTC (9 years, 10 months ago) by geira
fixed bug where timestamps were sent to oai-pmh instead of date
now parses oai-pmh error messages and dies gracefully
cleaned up error handling, now much more suicidal


Revision 868 - Directory Listing
Modified Mon Sep 20 14:18:05 2010 UTC (9 years, 10 months ago) by heikok
remove 'undefined' message

Revision 866 - Directory Listing
Modified Mon Sep 20 13:42:34 2010 UTC (9 years, 10 months ago) by geira
cleaned up log output


Revision 860 - Directory Listing
Modified Fri Sep 17 13:21:19 2010 UTC (9 years, 10 months ago) by geira
harvester rewritten to write harvest status to db
also now using log4perl


Revision 695 - Directory Listing
Modified Wed Jul 7 12:52:53 2010 UTC (10 years, 1 month ago) by heikok
connecting scripts to Log4perl

Revision 668 - Directory Listing
Modified Fri Jun 4 13:06:20 2010 UTC (10 years, 2 months ago) by heikok
fixing webrunsyserrors to webrun/syserrors

Revision 667 - Directory Listing
Modified Fri Jun 4 12:49:40 2010 UTC (10 years, 2 months ago) by heikok
fixing resumptionToken fetching (missing // in front of xpath)

Revision 655 - Directory Listing
Modified Mon May 31 15:34:18 2010 UTC (10 years, 2 months ago) by heikok
don't die if status-file doesn't exist for reading

Revision 644 - Directory Listing
Modified Thu May 27 10:48:06 2010 UTC (10 years, 2 months ago) by heikok
allowing for resumptionTokens in harvester
fixing locking of status-file

Revision 378 - Directory Listing
Modified Thu Jul 16 13:00:19 2009 UTC (11 years, 1 month ago) by heikok
using escaped (sane) name for dsname
catching setInfo exceptions and putting them to log-file

Revision 363 - Directory Listing
Modified Tue Jul 14 08:05:33 2009 UTC (11 years, 1 month ago) by heikok
clearer output-message

Revision 354 - Directory Listing
Modified Sat Jul 11 11:36:47 2009 UTC (11 years, 1 month ago) by heikok
adding validator for oai-pmh and dif (ipy-dif schema from julia collins)

Revision 328 - Directory Listing
Modified Mon May 11 15:50:46 2009 UTC (11 years, 3 months ago) by heikok
switching from start_services.sh and stop_services.sh to lsb-conform startup-script metamodInit.sh

Revision 325 - Directory Listing
Modified Mon May 11 06:55:35 2009 UTC (11 years, 3 months ago) by heikok
everything except shell-scripts and static files made run-time configurable

Revision 309 - Directory Listing
Modified Wed May 6 13:34:34 2009 UTC (11 years, 3 months ago) by heikok
removing all config statements from perl-files, except in use lib ...;

Revision 222 - Directory Listing
Modified Tue Feb 17 15:51:03 2009 UTC (11 years, 5 months ago) by heikok
fix bug: setInfo calls replaceInfo without joining elements

Revision 212 - Directory Listing
Modified Thu Feb 5 09:18:38 2009 UTC (11 years, 6 months ago) by egils
Added support for set harvesting

Revision 181 - Directory Listing
Modified Tue Jan 13 08:59:56 2009 UTC (11 years, 7 months ago) by egils
Added new web page for testing a netCDF file without uploading.
Small adjustments in harvester.pl.'

Revision 166 - Directory Listing
Modified Wed Dec 17 09:33:25 2008 UTC (11 years, 7 months ago) by heikok
finding status attribute (instead of element)
creating a valid, but empty dataset for status=deleted entries

Revision 147 - Directory Listing
Modified Mon Dec 8 10:27:42 2008 UTC (11 years, 8 months ago) by egils
Added mmTtime class for both perl and PHP

Revision 128 - Directory Listing
Modified Wed Nov 26 09:39:22 2008 UTC (11 years, 8 months ago) by heikok
additional debug-statements to STDERR

Revision 117 - Directory Listing
Modified Fri Nov 21 12:28:47 2008 UTC (11 years, 8 months ago) by heikok
removing unused constants
fixing warning on empty source lines

Revision 115 - Directory Listing
Modified Fri Nov 21 12:17:18 2008 UTC (11 years, 8 months ago) by heikok
using libxml to parse files
using transformer to extract dataset-information
using ForeignDataset to write xml/xmd files

Revision 104 - Directory Listing
Modified Wed Nov 19 09:49:50 2008 UTC (11 years, 8 months ago) by egils
Including outstanding updates in harvester

Revision 87 - Directory Listing
Modified Fri Nov 7 10:38:06 2008 UTC (11 years, 9 months ago) by egils
Common syserrors file for upload and harvest.

Revision 86 - Directory Listing
Modified Fri Nov 7 08:11:52 2008 UTC (11 years, 9 months ago) by egils
New directory path for quadtreeuse.pm. Bugfixes

Revision 78 - Directory Listing
Modified Tue Nov 4 09:28:13 2008 UTC (11 years, 9 months ago) by egils
Further developements in harvest

Revision 71 - Directory Listing
Modified Mon Nov 3 12:15:02 2008 UTC (11 years, 9 months ago) by egils
Added harvest script

Revision 47 - Directory Listing
Added Mon Oct 13 12:18:56 2008 UTC (11 years, 10 months ago) by egils
Initialized METAMODHARVEST module directories

svn@met.no
ViewVC Help
Powered by ViewVC 1.1.5