FTP Inlet RELEASE NOTES:
This document describes changes and bug fixes to the
AXT FTP Inlet outlet filter.
These changes may affect version upgrades, so if experiencing
problems after a version upgrade, please consult this document
and the major changes between the old and the new version.
The AXT configuration file allows setting of a log level so that more or
less information may be printed during run.
===============================================================
2008-04-28 FTP Inlet 3.1.1
===============================================================
+ Fixed a bug in the Schema so email address now can be a property also.
+ Support for XML namespace schema definition using AGETOR XML Catalog.
+ Note: Validation of the FTP inlet configuration files has been modified to use the provided XML Catalog.
This means that if the FTP inlet configurations and/or schema files does not contains the new namespace
validation on runtime is nolonger performed.
+ Added snippets to ease creation of new folders using Agetor workbench.
===============================================================
2008-09-12 FTP Inlet 3.1.0
===============================================================
+ Fixed a bug in the Schema so email address now can be a property also.
+ Added support for FTPS using the FTPSFolder tag:
+ Added support for SFTP using the SFTPFolder tag:
+ Configuration of individual folders may now be created in separate XML files.
Such additional XML-files should be placed in a sub-directory in the same
place and with the same name as the main FTP configuration file. This allows
for multiple running ftp instances as previously. The advantage of this approach
is that the configuration will be more structured and readable and that
it will be possible to add/exchange FTP configurations without the need of
merging files.
+ Schemas were split to support the possible split of configuration files.
+ Fixed a leap year ftp parsing bug
+ Optimized directory file parsing.
+ Added a delay on 20 seconds when starting the FTPinlet at servicerunner startup, to avoid problems contacting docdeliver.
===============================================================
2008-02-20 FTP Inlet 3.0.1
===============================================================
+ Added support for referencing the FILENAME axt key from inside the delivery tag
to support using the ftp inlet as a filemoving tool. I.e.
+ Bugfix: If no post-url is defined for a folder only the post actions
will be performed.
+ Bugfix: Out of diskspace could cause an onerror moveto command to execute with
and incomplete file, and afterwards deleted the original data. For incomplete
downloaded files the onerror actions is not performed, and the original files is
renamed to .failed if configured.
+ Bugfix: Failed counter was not always updated when using the DDS proxy
===============================================================
2007-09-03 FTP Inlet 3.0.0
===============================================================
+ Generic support of DDS delivery properties. Since delivery to
AXT is done through the DDS service, the configuration now
allow for all possible delivery parameters to the DDS (e.g.
retrypattern (new in 3.0), tentatives, checkpointonerror (new in
3.0 etc.). The parameters may be stated globally (for all
folders) and/or for the individual folder definitions.
This allows for overruling and fine-tuning of the DDS properties used
for delivery to AXT (e.g. retryPattern, checkpoint text on failure
etc.). A folder may have a delivery sub structure with the parameters.
+ The default AXT URL now refers to the AXT base address property
(agetor.admin.axt.host) which hold the configured base address of
AXT on the machine. I.e. the host/port address specified when AXT was
installed.
===============================================================
2007-01-15 AXT FTP Inlet 2.2.0
===============================================================
+ FTP inlet now ignores subfolders instead of throwing an exception
+ FTP inlet now uses the DDS service as a proxy for delivering to
AXT to ensure automatic delivery retries in face of delivery
errors. This can be disabled by setting the property:
axt.ftpinlet.disableDDSasProxy = true
+ Added support for sorting of files on folder level. A custom sorter
class can be used or one of the two supplied sorter classes can be used.
Namely TimeOrderSorter and FilenameSorter, which sorts the list of files
by time/date and filename respectively, see documentation for details.
+ Bugfix: unique-name was absent in the XSD-defintion causing problems
when defining folders that required unique naming be turned off.
===============================================================
2006-08-08 AXT FTP Inlet 2.1.0
===============================================================
+ Global level listfetchfrequency now used when folder level is
absent.
+ Correct handling of non-suffixed filenames.
===============================================================
2006-07-18 AXT FTP Inlet 2.0.10
===============================================================
+ This release adds support for local folders. The local folders
on the filesystem is configured in the ftpinlet.xml config file.
Using the new tag very similar to the tag.
+ Updated the .xsd schema validation file to support the filefolder
tag. Added quarantinetime attribute to folder tag
+ Bugfix: filenames without extension wasn't handled correctly within the
tag for the folder configuration.
+ Added the possibility to quarantine files in folders for a given time
period. Mostly useful avoid processing the same file several times, on ftp
servers which doesn't allow renaming or deletion of files.
+ Made it optional whether or not to use the redelivery support added in 2.0.7
which created massive amounts of data in some environments. Default is that
redelivery is enabled. (axt.ftpinlet.storeFailedFiles in the
properties configfile)
===============================================================
2006-02-13 AXT FTP Inlet 2.0.9
===============================================================
+ This release adds support of passive FTP-mode. The default
mode is still active but passive mode may be specified with
the property
axt.ftpinlet.activetransfermode=false
in file $AGETOR_HOME/conf/properties/axt/ftpinlet.properties
+ Folder-pattern displayed in ACC status view
+ Better project information on mail-notification
===============================================================
2005-09-26 AXT FTP Inlet 2.0.8
===============================================================
+ Important bugfix: The recent 2.0.7 release reversed the notion
of timeintervals defined in the FTP Inlet configuration. This
release fixes the problem.
===============================================================
2005-08-24 AXT FTP Inlet 2.0.7
===============================================================
+ Support for redelivery of files that could not be delivered to
AXT for processing. File data and meta-data are saved in
${AGETOR_HOME}/data/ftpinlet/failed using DocDeliver conventions
(.dat and .xml file) and may be redelivered with AXT DocDeliver(v. 2.0.10).
+ Exclusion of files with patterns: ".", ".." and "*.failed" to
avoid errors when pattern "*.*" is used for specifying files for
download.
===============================================================
2005-05-30 AXT FTP Inlet 2.0.6
===============================================================
+ Added multithreaded processing to increase robustness to
misbehaving FTP-servers and other communication maladies.
+ Support for increased throughput and QOS by multiple simultaneous
downloads and transformations.
+ Automatic takeover by new processors if a processor becomes inactive
or locked by badly behaving communication peer (FTP-server).
+ Surveillance of processors to ensure their healthiness.
+ Configurable mail-notification in case of processor timeout (inactivity).
+ Improved status information in AGETOR® Control Center.
+ Pause/restart on folder level.
+ Shipped with XSD schema for validation and documentation. This
is very usefull if you use a tool like XMLSpy for editing the
configuration since you may attach the schema and get completion
hints and help on usage.
+ Note, that with the validation metioned above, some configuration
attributes have had their allowed value range limited to avoid
misconfiguration. This means that you may have to correct your
existing configuration e.g if you use to small a value for
poll-frequency which now has a lower limit of 5000 (5 sec).
+ Improved responsiveness to stop command from AGETOR(r) Control Center.
===============================================================
2004-10-13 FTP Inlet 2.0.5
===============================================================
+ IMPORTANT: This version requires AXT Basic 2.0.4.
+ IMPORTANT: Added attribute "timeout" to the folder configuration.
This value, in seconds, can set a timeout value used in the
communication with the FTP-server. On some FTP-Servers or networks
there has been an error when the connection was lost without the
FTP-inlet getting notified. That caused the FTP-inlet to hang
requiring the service to be restarted. Moreover there is a new
property "axt.ftpinlet.timeout" that sets the default timeout when
it is not set on the different FTP-folders.
+ IMPORTANT: The FTP-Inlet has been updated, so it will try to
automatically select the right fileparser when communicating with
the FTP-server. That means that in most cases you no longer need
to set the fileparser attribute on the ftp-folders in the
configuration, just remove it. In some cases the fileparser needs
to be set to the correct one.
+ Fixed some problems that could make the inlet hang on some FTP servers.
+ Added a new fileparser, LinuxFTPFileListParser that suits most FTP servers on
Linux and also some servers on AIX. Please refer to the user guide for more
information.
+ The version number will now following the Agetor Install tool
versioning.
===============================================================
2004-07-07 FTP Inlet 2.0.4
===============================================================
+ IMPORTANT: A bug has been fixed where a file on the FTP-server
was not moved when an error occurred in AXT causing the file to
be repeatedly sent to AXT. A similar bug has previously been a
problem in the FTP Inlet. It is highly recommended to
update from FTP Inlet 2.03.
===============================================================
2004-03-15 FTP Inlet 2.0.3
===============================================================
+ It is now possible to send FTP site commands to the FTP-server
after the file has been handled by AXT or when an error occurs.
+ The different task under the and tags
are now done in the same order as specified in the configuration
file. That means that you can send a FTP site command to a file
before the file is moved and one after.
===============================================================
2004-01-21 FTP Inlet 2.0.2
===============================================================
+ IMPORTANT: The class “dk.bording.axt.client.ftp.FTPInletFileListParserBase”
has changed name to “dk.bording.axt.client.FTPFileListParserBase” and
the classes to get the directory listing from the FTP-server has been
moved to the AXT basic packaged.
+ IMPORTANT: Fix a bug where a file on the FTP-server was not moved when
an error occurred in AXT causing the file to repeatedly being sent to AXT.
+ IMPORTANT: When there was a connection error in the communication with
AXT the file on the FTP-server was moved. The file will now remain on
the FTP-server until AXT is up and running.
+ IMPORTANT: It is now possible to add one or more time intervals where
the specific folder is check for files.
+ The default username and password is now set to anonymous.
+ Fixed a bug where the FTPInlet was shutdown when no folders where
configured.
+ Fixed bug in “dk.bording.axt.client.ftpMSFTPFileListParser” where
filenames with spaces caused an error
===============================================================
2003-06-20 FTP Inlet 2.0.1
===============================================================
+ Unique filenames for copies of handled files may now be turned off
by setting the unique-name attribute to false in the and
tags of the configuration. This may be useful if the
same file is repeatedly delivered but only the latest processed
version should be saved.
+ The AXT configuration file allows setting of a loglevel so that more or
less information may be printet during run.
===============================================================
2003-05-23 FTP Inlet 2.0.0
===============================================================
+ IMPORTANT: Has been rebuild and packaged for use with AXT 2.0.0
and ADK 2.0.0.
===============================================================
2003-02-23 FTP Inlet 1.0.4
===============================================================
+ IMPORTANT: This update is highly recommended, especially when the remote
folders contain many files. New features have been added to handle
these situations. Please refer to the user guide for more information.
+ Added support for AIX FTP server.
+ User definable filename caches and request frequencies on folder level.
+ In the ServiceRunner details on files and folder properties are now
shown for the status command.
+ AXT processing of fetched files have been made optional. If no
tag is present or it has an empty value url parameter, the fetched document
is not sent to AXT for processing.
+ General optimizations in performance and architecture
===============================================================
2002-08-27 FTP Inlet 1.0.3
===============================================================
+ In the ServiceRunner the status is now showing how many bytes
has been downloaded of a file and how big the file is.
+ You can match more than one filename in a folder separated
with a semi-colon. Useful if you have more than one file
extension that you wants to handle as one, ex. "*.jpg;*.jpeg".
+ If the FTPInlet can’t connect to a folder it will after a while
send a mail to the administrator if the "onerror" element has
been added to the configuration. In the ServiceRunner you can
see if there is a problem with a folder.
+ Minor bug fixes