AGETOR 3 AXT FTP Inlet

This Inlet scans any number of configured FTP servers for documents ready to be fetches and sent to AXT.

[ICO]NameLast modifiedSizeDescription

[DIR]Parent Directory   -
[TXT]release.txt 28-Apr-2009 15:07 16K
[   ]axt_ftpinlet3_1_1.apa 28-Apr-2009 14:43 779K
[   ]axt_ftpinlet3_1_0.apa 12-Sep-2008 13:32 778K
[   ]axt_ftpinlet3_0_1.apa 27-Feb-2008 13:30 1.0M
[   ]axt_ftpinlet3_0_0.apa 11-Sep-2007 11:59 1.0M

FTP Inlet RELEASE NOTES:

This document describes changes and bug fixes to the
AXT FTP Inlet outlet filter.
These changes may affect version upgrades, so if experiencing
problems after a version upgrade, please consult this document	
and the major changes between the old and the new version.

The AXT configuration file allows setting of a log level so that more or
less information may be printed during run.

===============================================================
2008-04-28 FTP Inlet 3.1.1
===============================================================

+ Fixed a bug in the Schema so email address now can be a property also.

+ Support for XML namespace schema definition using AGETOR XML Catalog.

+ Note: Validation of the FTP inlet configuration files has been modified to use the provided XML Catalog. 
  This means that if the FTP inlet configurations and/or schema files does not contains the new namespace 
  validation on runtime is nolonger performed.
  
+ Added snippets to ease creation of new folders using Agetor workbench.    
  

===============================================================
2008-09-12 FTP Inlet 3.1.0
===============================================================
+ Fixed a bug in the Schema so email address now can be a property also.

+ Added support for FTPS using the FTPSFolder tag:
	<FTPSFolder server="${testpackage.ftps.server}" port="${testpackage.ftps.port}" user="${testpackage.ftps.user}" password="${testpackage.ftps.password}" name="${testpackage.ftps.folder}" filename="*.txt" ftpmode="passive" implicit="false" >
		<posturl>
			<param name="function" value="received-ftps"/>
		</posturl>
	</FTPSFolder>

+ Added support for SFTP using the SFTPFolder tag: 
	<SFTPFolder server="${testpackage.sftp.server}" port="${testpackage.sftp.port}" user="${testpackage.sftp.user}" password="${testpackage.sftp.password}" name="${testpackage.sftp.folder}" filename="*.txt">
		<posturl>
			<param name="function" value="received-sftp"/>
		</posturl>
	</SFTPFolder>

+ Configuration of individual folders may now be created in separate XML files.
  Such additional XML-files should be placed in a sub-directory in the same
  place and with the same name as the main FTP configuration file. This allows
  for multiple running ftp instances as previously. The advantage of this approach
  is that the configuration will be more structured and readable and that
  it will be possible to add/exchange FTP configurations without the need of
  merging files.
 
+ Schemas were split to support the possible split of configuration files.

+ Fixed a leap year ftp parsing bug

+ Optimized directory file parsing.

+ Added a delay on 20 seconds when starting the FTPinlet at servicerunner startup, to avoid problems contacting docdeliver.

===============================================================
2008-02-20 FTP Inlet 3.0.1
===============================================================
+ Added support for referencing the FILENAME axt key from inside the delivery tag
  to support using the ftp inlet as a filemoving tool. I.e.  		
  	<filefolder name="${AGETOR_HOME}/data/axt/examples/demo/orders" filename="*.xml"
		listfetchfrequency="10" age="5">
		<delivery>
			<param name="media" value="file"/>
			<param name="folder" value="c:\temp"/>
			<param name="mask" value="{FILENAME}"/>
		</delivery>
	</filefolder>

  
  
+ Bugfix: If no post-url is defined for a folder only the post actions
  will be performed.
  
+ Bugfix: Out of diskspace could cause an onerror moveto command to execute with 
  and incomplete file, and afterwards deleted the original data. For incomplete 
  downloaded files the onerror actions is not performed, and the original files is 
  renamed to .failed if configured. 
  
+ Bugfix: Failed counter was not always updated when using the DDS proxy

===============================================================
2007-09-03 FTP Inlet 3.0.0
===============================================================
+ Generic support of DDS delivery properties. Since delivery to 
  AXT is done through the DDS service, the configuration now
  allow for all possible delivery parameters to the DDS (e.g.
  retrypattern (new in 3.0), tentatives, checkpointonerror (new in
  3.0 etc.). The parameters may be stated globally (for all 
  folders) and/or for the individual folder definitions.
  This allows for overruling and fine-tuning of the DDS properties used
  for delivery to AXT (e.g. retryPattern, checkpoint text on failure
  etc.). A folder may have a delivery sub structure with the parameters.
  
  	 <filefolder name="${AGETOR_HOME}/data/test/input2" filename="*.file" 
  	 	listfetchfrequency="5" age="5"
	   	retrypattern="none">
		<delivery>
			<param name="media" value="file"/>
  	      	<param name="description" value="file to file dir delivery"/>
  	      	<param name="synchronized" value="true"/>
	        <param name="serie" value="file-file"/>
	        <param name="mask" value="filefile%s.txt"/>
	        <param name="folder" value="${AGETOR_HOME}/data/test/output2"/>
		</delivery>
	</filefolder>

+ The default AXT URL now refers to the AXT base address property 
  (agetor.admin.axt.host) which hold the configured base address of 
  AXT on the machine. I.e. the host/port address specified when AXT was
  installed.
  
===============================================================
2007-01-15 AXT FTP Inlet 2.2.0
===============================================================
+ FTP inlet now ignores subfolders instead of throwing an exception

+ FTP inlet now uses the DDS service as a proxy for delivering to 
  AXT to ensure automatic delivery retries in face of delivery
  errors. This can be disabled by setting the property:

	  axt.ftpinlet.disableDDSasProxy = true
  
+ Added support for sorting of files on folder level. A custom sorter
  class can be used or one of the two supplied sorter classes can be used.
  Namely TimeOrderSorter and FilenameSorter, which sorts the list of files 
  by time/date and filename respectively, see documentation for details.
  
+ Bugfix: unique-name was absent in the XSD-defintion causing problems
  when defining folders that required unique naming be turned off.

===============================================================
2006-08-08 AXT FTP Inlet 2.1.0
===============================================================
+ Global level listfetchfrequency now used when folder level is 
  absent.

+ Correct handling of non-suffixed filenames.

===============================================================
2006-07-18 AXT FTP Inlet 2.0.10
===============================================================
+ This release adds support for local folders. The local folders
  on the filesystem is configured in the ftpinlet.xml config file.
  Using the new <filefolder> tag very similar to the <folder> tag. 

+ Updated the .xsd schema validation file to support the filefolder 
  tag. Added quarantinetime attribute to folder tag
  
+ Bugfix: filenames without extension wasn't handled correctly within the
  <moveTo> tag for the folder configuration. 

+ Added the possibility to quarantine files in folders for a given time
  period. Mostly useful avoid processing the same file several times, on ftp
  servers which doesn't allow renaming or deletion of files.
  
+ Made it optional whether or not to use the redelivery support added in 2.0.7
  which created massive amounts of data in some environments. Default is that
  redelivery is enabled. (axt.ftpinlet.storeFailedFiles in the 
  properties configfile)

===============================================================
2006-02-13 AXT FTP Inlet 2.0.9
===============================================================
+ This release adds support of passive FTP-mode. The default
  mode is still active but passive mode may be specified with
  the property
  
  	axt.ftpinlet.activetransfermode=false
  
  in file $AGETOR_HOME/conf/properties/axt/ftpinlet.properties

+ Folder-pattern displayed in ACC status view

+ Better project information on mail-notification

===============================================================
2005-09-26 AXT FTP Inlet 2.0.8
===============================================================
+ Important bugfix: The recent 2.0.7 release reversed the notion
  of timeintervals defined in the FTP Inlet configuration. This
  release fixes the problem.

===============================================================
2005-08-24 AXT FTP Inlet 2.0.7
===============================================================
+ Support for redelivery of files that could not be delivered to
AXT for processing. File data and meta-data are saved in 
${AGETOR_HOME}/data/ftpinlet/failed using DocDeliver conventions
(.dat and .xml file) and may be redelivered with AXT DocDeliver(v. 2.0.10).

+ Exclusion of files with patterns: ".", ".." and "*.failed" to
avoid errors when pattern "*.*" is used for specifying files for
download.

===============================================================
2005-05-30 AXT FTP Inlet 2.0.6
===============================================================
+ Added multithreaded processing to increase robustness to 
  misbehaving FTP-servers and other communication maladies.
  
+ Support for increased throughput and QOS by multiple simultaneous
  downloads and transformations.

+ Automatic takeover by new processors if a processor becomes inactive 
  or locked by badly behaving communication peer (FTP-server).
  
+ Surveillance of processors to ensure their healthiness.

+ Configurable mail-notification in case of processor timeout (inactivity).

+ Improved status information in AGETOR® Control Center.

+ Pause/restart on folder level.

+ Shipped with XSD schema for validation and documentation. This
  is very usefull if you use a tool like XMLSpy for editing the
  configuration since you may attach the schema and get completion
  hints and help on usage. 
  
+ Note, that with the validation metioned above, some configuration 
  attributes have had their allowed value range limited to avoid 
  misconfiguration. This means that you may have to correct your 
  existing configuration e.g if you use to small a value for 
  poll-frequency which now has a lower limit of 5000 (5 sec).
  
+ Improved responsiveness to stop command from AGETOR(r) Control Center.

===============================================================
2004-10-13 FTP Inlet 2.0.5
===============================================================
+ IMPORTANT: This version requires AXT Basic 2.0.4.

+ IMPORTANT: Added attribute "timeout" to the folder configuration. 
  This value, in seconds, can set a timeout value used in the 
  communication with the FTP-server. On some FTP-Servers or networks 
  there has been an error when the connection was lost without the 
  FTP-inlet getting notified. That caused the FTP-inlet to hang 
  requiring the service to be restarted. Moreover there is a new 
  property "axt.ftpinlet.timeout" that sets the default timeout when 
  it is not set on the different FTP-folders. 

+ IMPORTANT: The FTP-Inlet has been updated, so it will try to 
  automatically select the right fileparser when communicating with 
  the FTP-server. That means that in most cases you no longer need 
  to set the fileparser attribute on the ftp-folders in the 
  configuration, just remove it. In some cases the fileparser needs 
  to be set to the correct one.
  
+ Fixed some problems that could make the inlet hang on some FTP servers.
  
+ Added a new fileparser, LinuxFTPFileListParser that suits most FTP servers on
  Linux and also some servers on AIX. Please refer to the user guide for more
  information.

+ The version number will now following the Agetor Install tool 
  versioning.

===============================================================
2004-07-07 FTP Inlet 2.0.4
===============================================================
+ IMPORTANT: A bug has been fixed where a file on the FTP-server 
  was not moved when an error occurred in AXT causing the file to 
  be repeatedly sent to AXT. A similar bug has previously been a 
  problem in the FTP Inlet. It is highly recommended to 
  update from FTP Inlet 2.03.

===============================================================
2004-03-15 FTP Inlet 2.0.3
===============================================================
+ It is now possible to send FTP site commands to the FTP-server 
  after the file has been handled by AXT or when an error occurs. 

+ The different task under the <whenhandled> and <onerror> tags 
  are now done in the same order as specified in the configuration 
  file. That means that you can send a FTP site command to a file 
  before the file is moved and one after. 

===============================================================
2004-01-21 FTP Inlet 2.0.2
===============================================================
+ IMPORTANT: The class “dk.bording.axt.client.ftp.FTPInletFileListParserBase” 
  has changed name to “dk.bording.axt.client.FTPFileListParserBase” and 
  the classes to get the directory listing from the FTP-server has been 
  moved to the AXT basic packaged. 

+ IMPORTANT: Fix a bug where a file on the FTP-server was not moved when 
  an error occurred in AXT causing the file to repeatedly being sent to AXT. 

+ IMPORTANT: When there was a connection error in the communication with 
  AXT the file on the FTP-server was moved. The file will now remain on 
  the FTP-server until AXT is up and running.

+ IMPORTANT: It is now possible to add one or more time intervals where 
  the specific folder is check for files.

+ The default username and password is now set to anonymous.

+ Fixed a bug where the FTPInlet was shutdown when no folders where 
  configured.

+ Fixed bug in “dk.bording.axt.client.ftpMSFTPFileListParser” where 
  filenames with spaces caused an error

===============================================================
2003-06-20 FTP Inlet 2.0.1
===============================================================
+ Unique filenames for copies of handled files may now be turned off
  by setting the unique-name attribute to false in the <moveto> and 
 <replyfile> tags of the configuration. This may be useful if the
  same file is repeatedly delivered but only the latest processed
  version should be saved.

+ The AXT configuration file allows setting of a loglevel so that more or
  less information may be printet during run.

===============================================================
2003-05-23 FTP Inlet 2.0.0
===============================================================
+ IMPORTANT: Has been rebuild and packaged for use with AXT 2.0.0 
  and ADK 2.0.0. 

===============================================================
2003-02-23 FTP Inlet 1.0.4
===============================================================
+ IMPORTANT: This update is highly recommended, especially when the remote
  folders contain many files. New features have been added to handle
  these situations. Please refer to the user guide for more information.

+ Added support for AIX FTP server.

+ User definable filename caches and request frequencies on folder level.

+ In the ServiceRunner details on files and folder properties are now
  shown for the status command.

+ AXT processing of fetched files have been made optional. If no <posturl>
  tag is present or it has an empty value url parameter, the fetched document
  is not sent to AXT for processing.

+ General optimizations in performance and architecture

===============================================================
2002-08-27 FTP Inlet 1.0.3
===============================================================
+ In the ServiceRunner the status is now showing how many bytes
  has been downloaded of a file and how big the file is.

+ You can match more than one filename in a folder separated
  with a semi-colon. Useful if you have more than one file
  extension that you wants to handle as one, ex. "*.jpg;*.jpeg".

+ If the FTPInlet can’t connect to a folder it will after a while
  send a mail to the administrator if the "onerror" element has
  been added to the configuration. In the ServiceRunner you can
  see if there is a problem with a folder.

+ Minor bug fixes