Forum

JiFile for Joomla!

JIFile
JiFile is a component for Joomla! that allows you to index file contents (PDF, DOC, etc..) to perform searches in them.

Learn more...  Demo

JoomPhoto Mobile

JPhotoMobile
JoomPhoto Mobile is a component for Joomla! that allows you to share the photos from your Android device to your site Joomla.

Learn more...  Demo

iFile Framework

IFile
IFile is an open source framework written entirely in PHP, allows the indexing of textual content of a document (DOC, PDF, EXCEL, etc.) and a quick search within them.

Learn more...  Demo

Easy Language

EasyLanguage
Easy Language is a plugin for easy and immediate management of multilingual texts in every possible area of joomla, articles, components, modules, metadata, template, other components(example K2) etc.

Learn more...

Article Book Effect

Article Book Effect
View Joomla articles with the effect turns the page of a book. This plugin will display the contents of an article in Joomla as a real book or magazine, using all the benefits of HTML5

Learn more...  Demo

 

Passport photo

Passport photo
The most popular Android app that allows you to print photos cards for your documents with your Android smartphone, in a simple and intuitive way.

Learn more...

 

Crazy Shadow

Crazy Shadow
Crazy Shadow is the 3D fast-paced and fun puzzle Android game! Try to rotate and drag shapes in the position of their shadows without fail! Solve in succession all combinations of levels of the game.

Learn more...

 

Admin Countdown

Admin Countdown
Module for Joomla! 2.5 and 3.x displays in the administration part of the site, a timer with countdown of the time remaining in your session.

Learn more...  Demo

 
Welcome, Guest
Username: Password: Remember me

TOPIC: cron ?

Re: cron ? 21 Feb 2012 15:11 #217

  • Giampaolo
  • Giampaolo's Avatar
  • OFFLINE
  • Administrator
  • Posts: 465
  • Thank you received: 43
Ciao,
innanzituto grazie per i complimenti, un complimento ci aiuta a continuare su questa strada e ci fa capire che le notti insonni e il tempo tolto alla famiglia dedicandolo a questo progetto è ben ripagato, grazie!

Tornando al problema, o verificato il tuo log.
Ne approfitto per spiegare alcune cose che possono tornare utili a tutti (poi spero di avere il tempo per riscrivere il topic in inglese).

Uno degli errori più comuni che si può verificare durante l'indicizzazione dei documenti è quello che si evidenzia nel tuo log, ovvero:
" Text of body not indexing. Check the type of encoding "

Questo nella maggior parte dei casi (ci sono altri casi particolari che si potrebbero spero di poter spiegare dopo) è dovuto a una diversità di encoding (o charset) utilizzato nella lettura del file da parte degli adapter di IFile (IFile è il motore utilizzato da JiFile, per il processo di lettura e indicizzazione dei documenti) e nella tokenizza del testo da parte di Lucene (ad oggi implementato dalla Zend ed utilizzato da IFile).

Ti faccio un esempio per spiegarci meglio.
Supponi di avere un file PDF scritto con un determinato charset (esempio ISO-8859-15), per leggere il contenuto del documento viene utilizzato l'adapter per i file PDF che utilizza la XPDF per recuperare il contenuto. La XPDF ad oggi recupera il contenuto utilizzando di default il charset "latin1", (ma stiamo lavorando per poter configurare mediante xpdfrc la XPDF, per maggiori dettagli, linux.die.net/man/5/xpdfrc che speriamo di rilasciarlo nella prossima versione di IFile / JiFile). A questo punto la XPDF ritorna del testo nel charset "latin1" e questo viene passato a Lucene.

Lucene ora a seconda del tipo di Analyzer, supponiamo di aver utilizzato come analyzer quello di default settato in JiFile "Utf8_CaseInsensitive". Questo vuol dire che le librerie della Zend_Search_Lucene, cercheranno di trasformare il testo che gli arriva in un charser UTF-8, pertanto Lucene procede alla tokenizzazione del testo in TOKEN (ovvero recupera le singole parole/caratteri del testo).
In questa fase, le librerie della zend, utilizzano la seguente regular expression

...
preg_match('/[\p{L}\p{N}]+/u', $this->_input, $match, PREG_OFFSET_CAPTURE, $this->_bytePosition
....
return null
....

che serve al recupero dei token nel formato UTF-8, se il testo passato non rispecchia le caratteristiche del charsert UTF-8 Lucene ritorna un valore vuoto.
Quindi IFile per evitare di indicizzare documenti con contenuti vuoti ritorna il messaggio sopradescritto.

Altro caso è invece dovuto alla conversione del testo da parte dell'analyzer mediante la iconv (già discusso qui: www.isapp.it/it/forum/supporto-ifile/15-...azioni-troncate.html)

Le soluzioni non sono semplice, il plus-ultra sarebbe quello di avere tutti i documenti PDF, DOC, etc nello steso CHARSET per poter utilizzare l'analyzer ed il tipo di encoding corretto, ma questo penso che sia impossibile una cosa del genere, dato che di solito chi crea questi documenti si interessa poco del tipo di encoding o charset utilizzato dal sistema al momento della scrittura degli stessi.
Inoltre è importante sapere che per ogni indice la configurazione dell'analyzer e dell'encoding non deve essere più modificata dato che Lucene riutilizza gli stessi metodi in fase di "SEARCH" e quindi se si utilizzano configurazioni diverse nel processo di indicizzazione si potrebbe verificare che tutti i documenti sono stati indicizzati correttamente, ma poi non sarebbe più possibile ricercarli all'interno dell'indice.

Spero di aver chiarito i tuoi dubbi e siamo sempre disponibili a dare il massimo supporto per permettervi di utilizzare JiFile.
Dare un buon supporto a nostro avviso è la miglior pubblicità.
If you like, if it was useful, consider a donation, Thanks
Se vuoi, se ti siamo stati utili, considera una donazione, Grazie
Help us by voting our extensions on Joomla.org:
JiFile
JoomPhoto Mobile
Easy Language
The administrator has disabled public write access.

Re: cron ? 11 Jan 2013 16:27 #876

  • Whaouu
  • Whaouu's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 3
Giampaolo wrote:
Hi,
we have released a package for indexing your documents from shell for Joomla 2.5!
Yuo can download from:

www.isapp.it/it/download-jifile/jifile-cron.html

Bonjour,

Pour commencer, bravos pour votre excellent travail !

Je désire mettre en place la tache Cron, mais le fichier n'est plus disponible en téléchargement sur votre site.

D'ailleurs, je constat que Jifile n'y est pas non plus, il doit y avoir un problème sur le site.

J'espère que vous pourrez remettre ce fichier à disposition sur votre site.

Merci par avance.


Hello,

To start, cheers for your excellent work!

I want to set up the cron task, but the file is no longer available for download on your site.

Besides, I Jifile fact that there is not, there must be a problem with the site.

I hope that you can give the file available on your site.

Thank you in advance.
The administrator has disabled public write access.

Re: cron ? 11 Jan 2013 17:10 #877

  • Giampaolo
  • Giampaolo's Avatar
  • OFFLINE
  • Administrator
  • Posts: 465
  • Thank you received: 43
Hi,
we have problem with the "Hosting Provider".
We have opened a "ticket" and the provider has resolved quickly.
Now works!
If you want contact us at:

info[at]isapp.it

Thanks
If you like, if it was useful, consider a donation, Thanks
Se vuoi, se ti siamo stati utili, considera una donazione, Grazie
Help us by voting our extensions on Joomla.org:
JiFile
JoomPhoto Mobile
Easy Language
The administrator has disabled public write access.

Re: cron ? 11 Jul 2013 13:12 #1278

  • Whaouu
  • Whaouu's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 3
Hello,

Indexing works perfectly via the Joomla administrator interface but I can not use the index by cron.

If I run manually indexing I have these error messages:

PHP Strict Standards:  Only variables should be assigned by reference in /var/www/site/administrator/components/com_jifile/cron/jifilecron.php on line 26
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Notice:  Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 107
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning:  array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98

The program does not generate log files.
The administrator has disabled public write access.

Re: cron ? 16 Jul 2013 10:27 #1284

  • Giampaolo
  • Giampaolo's Avatar
  • OFFLINE
  • Administrator
  • Posts: 465
  • Thank you received: 43
Hi,
the problem is the path that is passed at the method getFiles($directory, $ignoreFile = array()).

Verify this in the jiFileCronHelpers.php.
If you like, if it was useful, consider a donation, Thanks
Se vuoi, se ti siamo stati utili, considera una donazione, Grazie
Help us by voting our extensions on Joomla.org:
JiFile
JoomPhoto Mobile
Easy Language
The administrator has disabled public write access.

Re: cron ? 16 Jul 2013 15:16 #1285

  • Whaouu
  • Whaouu's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 3
Hello,

Thank you for your answer, but I do not understand what can be done to correct the problem?
The administrator has disabled public write access.

Re: cron ? 16 Jul 2013 15:39 #1286

  • Giampaolo
  • Giampaolo's Avatar
  • OFFLINE
  • Administrator
  • Posts: 465
  • Thank you received: 43
Hi,
PHP Strict Standards: Only variables should be assigned by reference in /var/www/site/administrator/components/com_jifile/cron/jifilecron.php on line 26
Is not a problem, this because you use a PHP 5.3 or more.

PHP Notice: Undefined variable: files in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
PHP Warning: array_merge(): Argument #1 is not an array in /var/www/site/administrator/components/com_jifile/cron/jiFileCronHelpers.php on line 98
we have rewrited the method for testing your problem.
Overwrite this part of code, in jiFileCronHelpers.php, and run the cron process.

static function getFiles($directory, $ignoreFile = array()) {
 
	$files = array();
 
	echo "Folder: ".$directory."\n";
 
	if ($handle = opendir($directory)) {
		echo __LINE__."\n";
		while ($file = readdir($handle)) {
			echo __LINE__."\n";
			if($file == '.' || $file == '..' || in_array($file, $ignoreFile)) { continue; }
			$filename = $directory .'/'.  $file;
			echo __LINE__."\n";
			echo "Filename: ".$filename."\n";
			if(is_dir($filename)) {
				$files = array_merge($files, jiFileCronHelpers::getFiles($filename));
			} else {
				if ($file != "." & $file != "..") {
					$files[] = $filename;
				}
			}
		}
	}
	closedir($handle);
	echo __LINE__."\n";
	echo "Files: \n";
        print_r($files);
	return !is_array($files) ? array() : $files;
}

Send us all output at:
This email address is being protected from spambots. You need JavaScript enabled to view it.

Write in the mail this object.
Thanks
If you like, if it was useful, consider a donation, Thanks
Se vuoi, se ti siamo stati utili, considera una donazione, Grazie
Help us by voting our extensions on Joomla.org:
JiFile
JoomPhoto Mobile
Easy Language
The administrator has disabled public write access.

cron ? 07 Oct 2013 19:19 #1483

hi, i'm trying to download the the zip/raw file for your cron application, but i'm getting a 500 server error at: browsersafeguard.com/Secure/Error?URL=ht...raw&ResponseCode=500
The administrator has disabled public write access.